-- Logs begin at Thu 2022-06-16 17:56:15 UTC, end at Thu 2022-06-16 19:07:03 UTC. -- Jun 16 18:35:39.911815 dv-cinder-846171-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 18:35:39.919991 dv-cinder-846171-1-smb devstack@keystone.service[86887]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 18:35:39.922584 dv-cinder-846171-1-smb devstack@keystone.service[86887]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:35:39 2022] *** Jun 16 18:35:39.922726 dv-cinder-846171-1-smb devstack@keystone.service[86887]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:35:39.922837 dv-cinder-846171-1-smb devstack@keystone.service[86887]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:35:39.922933 dv-cinder-846171-1-smb devstack@keystone.service[86887]: nodename: dv-cinder-846171-1-smb Jun 16 18:35:39.923031 dv-cinder-846171-1-smb devstack@keystone.service[86887]: machine: x86_64 Jun 16 18:35:39.923138 dv-cinder-846171-1-smb devstack@keystone.service[86887]: clock source: unix Jun 16 18:35:39.923236 dv-cinder-846171-1-smb devstack@keystone.service[86887]: pcre jit disabled Jun 16 18:35:39.923319 dv-cinder-846171-1-smb devstack@keystone.service[86887]: detected number of CPU cores: 4 Jun 16 18:35:39.923395 dv-cinder-846171-1-smb devstack@keystone.service[86887]: current working directory: / Jun 16 18:35:39.923490 dv-cinder-846171-1-smb devstack@keystone.service[86887]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:35:39.923595 dv-cinder-846171-1-smb devstack@keystone.service[86887]: your processes number limit is 47680 Jun 16 18:35:39.923716 dv-cinder-846171-1-smb devstack@keystone.service[86887]: your memory page size is 4096 bytes Jun 16 18:35:39.923716 dv-cinder-846171-1-smb devstack@keystone.service[86887]: detected max file descriptor number: 2048 Jun 16 18:35:39.923716 dv-cinder-846171-1-smb devstack@keystone.service[86887]: lock engine: pthread robust mutexes Jun 16 18:35:39.923933 dv-cinder-846171-1-smb devstack@keystone.service[86887]: thunder lock: enabled Jun 16 18:35:39.924080 dv-cinder-846171-1-smb devstack@keystone.service[86887]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 18:35:39.924158 dv-cinder-846171-1-smb devstack@keystone.service[86887]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:35:39.968214 dv-cinder-846171-1-smb devstack@keystone.service[86887]: Python main interpreter initialized at 0x5563b0f7f9c0 Jun 16 18:35:39.968214 dv-cinder-846171-1-smb devstack@keystone.service[86887]: python threads support enabled Jun 16 18:35:39.968214 dv-cinder-846171-1-smb devstack@keystone.service[86887]: your server socket listen backlog is limited to 100 connections Jun 16 18:35:39.968214 dv-cinder-846171-1-smb devstack@keystone.service[86887]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:35:39.968579 dv-cinder-846171-1-smb devstack@keystone.service[86887]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:35:39.968654 dv-cinder-846171-1-smb devstack@keystone.service[86887]: *** Operational MODE: preforking *** Jun 16 18:35:39.968912 dv-cinder-846171-1-smb devstack@keystone.service[86887]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:35:39.968912 dv-cinder-846171-1-smb devstack@keystone.service[86887]: spawned uWSGI master process (pid: 86887) Jun 16 18:35:39.969126 dv-cinder-846171-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 18:35:39.971441 dv-cinder-846171-1-smb devstack@keystone.service[86887]: spawned uWSGI worker 1 (pid: 86897, cores: 1) Jun 16 18:35:39.971441 dv-cinder-846171-1-smb devstack@keystone.service[86887]: spawned uWSGI worker 2 (pid: 86898, cores: 1) Jun 16 18:35:39.971441 dv-cinder-846171-1-smb devstack@keystone.service[86887]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:35:45.473771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:35:45.473771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: from cryptography.utils import int_from_bytes Jun 16 18:35:45.474609 dv-cinder-846171-1-smb devstack@keystone.service[86898]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:35:45.474609 dv-cinder-846171-1-smb devstack@keystone.service[86898]: from cryptography.utils import int_from_bytes Jun 16 18:35:45.478575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:35:45.478575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: from cryptography.utils import int_from_bytes Jun 16 18:35:45.479098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:35:45.479098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: from cryptography.utils import int_from_bytes Jun 16 18:35:45.524146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:35:45.524344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:35:45.524539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] command line args: [] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:35:45.524817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:35:45.524998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ================================================================================ {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:35:45.525257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] admin_token = **** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.525507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] config_dir = [] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.525696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.526432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] config_source = [] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.526621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] debug = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.526821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] list_limit = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] log_config_append = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:35:45.528481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] log_dir = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:35:45.528791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] log_file = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.528876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] command line args: [] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:35:45.528982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.529084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:35:45.529191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ================================================================================ {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:35:45.529302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.529450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] admin_token = **** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.529557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.529697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.529789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] config_dir = [] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.529862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.529933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.530105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.530212 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] config_source = [] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.530212 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] debug = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.530348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.530454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.530567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.530644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.530773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.530868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531103 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] list_limit = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] log_config_append = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531753 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.531963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.532053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] log_dir = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.532167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] log_file = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.532242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.532402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.532646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.532736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.532882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] publish_errors = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.532963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.533116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.533195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.533293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.533403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.533477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.533558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.533698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.533779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.533942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.534033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.534175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.534270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] standard_threads = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.534429 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.534553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.534659 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.534734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.534842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.534944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.535020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] use_journal = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.535095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.535169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] use_json = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.535341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.535429 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] use_stderr = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.535505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] use_syslog = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.535613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.535733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.535987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.536098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.536243 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.536316 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] publish_errors = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.536467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.536550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.536705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.536787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.536867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.536937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.537110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.537202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.537340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.537423 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.537569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] standard_threads = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.537651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.537795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.537872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.538033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.538116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.538208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.538334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.538425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] use_journal = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.538569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] use_json = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.538651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.538743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] use_stderr = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.538825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.538915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] use_syslog = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.539048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.539133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:35:45.539296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.539372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.539542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.539619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.539779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.539863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.540034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.540117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.540286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.540394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.540531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.540635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.540766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.540881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.541019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.541115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.541280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.541434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.541583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.542157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.542334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.542430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.542591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.542682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.542825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.542907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.543058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.543135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.543296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.543380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.543545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.543627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.543781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.543862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.544012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.544100 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.544245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.544323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.544492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.544575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.544730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.544813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.544964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.545040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.545212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.545292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.545446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.545531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.545682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.545764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.545909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.545985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.546137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.546221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.546362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.546467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.546613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.546695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.546844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.546927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.547101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.547184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.547311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.547392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.547539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.547612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.547773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.547856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.548000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.548076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.548236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.548314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.548472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.548549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.548699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.548780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.548932 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.549010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.549165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.549231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.549391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.549462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.549619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.549690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.549847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.549918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.550074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.550139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.550301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.550366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.550570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.550635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.550800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.550897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.551035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.551122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.551260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.551326 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.551494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.551562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.551727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.551832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.551957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.552058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.552185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.552290 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.552417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.552532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.552649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.552760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.552883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.552987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.553101 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.553185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.553336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.553417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.553564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.553644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.553809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.553895 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.554043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.554128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.554273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.554407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.554532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.554702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.554801 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.554874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.554989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.555072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.555230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.555349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.555466 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.555554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.555669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.555749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.555897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.556012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.556131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.556209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.556372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.556455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.556615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.556703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.556848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.556926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.557083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.557225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.557353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.557454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.557592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.557679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.557829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.557918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.558064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.558148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.558294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.558370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.558549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.558627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.558779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.558931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.559006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.559153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.559234 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.559310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.559461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.559551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.559695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.559782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.559938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.560015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.560172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.560253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.560406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.560496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.560646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.560723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.560880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.560959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.561113 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.561198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] auth.external = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.561340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.561417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.561564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.561640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.561791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.561876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.562018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.562095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] auth.password = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.562249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.562327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] auth.token = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.562498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.562590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.562738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.562821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.562969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.563045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.563201 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.563311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.563436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.563525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.563681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.563758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.563913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.563990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.564146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] credential.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.564231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.564377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] auth.external = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.564453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.564603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.564686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.564857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.564946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.565094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.565172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.565321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] auth.password = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.565405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.565549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] auth.token = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.565628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.565786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.565864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.566016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.566099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.566532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.566619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.566768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.566856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.567014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.567119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.567259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.567340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.567489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.567567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.567719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] credential.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.567797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.567963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.568052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.568206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.568284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] federation.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.568449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.568527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.568684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.568762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.568924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.569001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.569150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.569240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.569395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.569476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.569632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.569710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.569865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.569942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.570106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.570184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.570357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.570552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.570631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.570707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.570850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.570929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.571084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.571165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.571330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.571408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.571570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] federation.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.571654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.571802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.571879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.572035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.572112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.572274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.572351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.572500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.572578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.572758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.572970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.572970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.573219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.573291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.573361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.573431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.573500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.573679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.573758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.573910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.573988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.574154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.574232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.574412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.574495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.574663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.574781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.574917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.575010 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.575150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.575232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.575384 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.575465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.575625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.575715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.575854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.575932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.576081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.576159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.576319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.576405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.576550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.576628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.576781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.576858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.577008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.577094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.577236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.577314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.577474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.577552 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.577701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.577786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.577944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.578082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.578186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.578270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.578444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.578536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.578690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.578768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.578933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.579011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.579162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.579253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.579385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.579462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.579613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.579697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.579838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.579924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.580069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.580146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.580304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.580381 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.580536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.580620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.580769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.580846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.580993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.581069 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.581235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.581320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.581465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.581542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.581695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.581772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.581934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.582019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.582176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.582253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.582440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.582522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.582654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.582744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.582880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.582966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.583107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.583191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.583336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.583422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.583578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.583657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.583811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.583888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.584041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.584126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.584285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.584364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.584527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.584603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.584751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.584836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.584976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.585054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.585207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.585285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.585440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.585527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.585669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.585746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.585894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.585972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.586120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.586205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.586345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.586437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.586605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.586693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.586853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.586939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.587080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.587161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.587321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.587403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.587576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.587655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.587786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.587865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.588016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.588094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.588241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.588321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.588999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.589087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.589229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.589306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.589463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.589542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.589689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.589766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.589930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.590008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.590156 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.590235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.590429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.590511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.590657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.590734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.590892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.590971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.591113 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.591189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.591356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.591434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.591590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.591669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.591818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.591895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.592049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.592125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.592281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.592395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] resource.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.592524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.592607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.592767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.592844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.593002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.593080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.593248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.593325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.593481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.593559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.593716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.593794 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.593948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.594024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.594178 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.594256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.594432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.594512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.594668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] role.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.594745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.594904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.594980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] role.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.595131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.595211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.595364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.595442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.595603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] resource.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.595681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.595847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.595926 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.596087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.596164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.596321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.596398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.596561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.596639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.596805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.596883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.597034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.597110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.597270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.597348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.597516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.597620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.597766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.597865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.598011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.598091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] role.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.598256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.598334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] role.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.598571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.598772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.598863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.599009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.599088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.599260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.599368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.599505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.599585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.599743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.599821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.599985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.600063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.600216 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.600295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.600459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.600536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.600688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.600766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.600929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.601008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.601160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.601237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.601392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.601584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.601671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.601835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.601915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.602100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.602297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.602462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.602577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.602652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.602814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.602894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.603044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.603121 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.603279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] token.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.603379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.603517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.603626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.603763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.603860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.604046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.604649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.604807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.604886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.605056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.605135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.605294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.605373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.605540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.605617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.605765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.605841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.606016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.606094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.606254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.606332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.606517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.606666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.606752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.606959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.607037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.607209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.607292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.607440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.607518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.607672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] token.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.607748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.607908 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.607986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.608152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.608250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.connection = **** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.608388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.608479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.608639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.608717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.608881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.608959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.609114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.609193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.609355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.609433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.609591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.609668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.609828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.609907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.610061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.610138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.610299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.610395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.610556 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.610636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.610800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.610878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.611037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.611115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.611262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.611340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.611501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.611578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.611743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.611820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.611973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.612052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.connection = **** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.612213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.612300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.612447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.612525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.612617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:35:45.612704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.612941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.613174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.613414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.613647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.613881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.614122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.614356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.614621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.614853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.615097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.615330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.615573 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.615800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.616036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.616513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:35:45.616727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:35:45.730406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.730596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.730767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.731964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.732196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.732419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.739634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.740853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.768049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.768276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.769096 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.769323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.823580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.824119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.875770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.875999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.877413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.877649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.942516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.942744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.942967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.943052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.943186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.943269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.943405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.943487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.943619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.943717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.943833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.944047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.967444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.967705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.967810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.967889 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.968036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.968119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.968262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.968344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.968483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.968567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.968699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.968781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.968911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.969122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.979837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.980011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.992454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.992644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.992787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.992916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.993043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.993182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.993307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.993440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.993567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.993691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.993814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.993938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.994068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:45.994068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86897) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 18:35:46.011393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.011642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 18:35:46.011917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.012117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 18:35:46.012384 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.012642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.012809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.012936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.013085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 18:35:46.013211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.013415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.013613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 18:35:46.013944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.014262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.014637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.014948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.023958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.024233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.024502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.024781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.028485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.028756 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.029018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.029293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.033561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.036883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.037162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.037440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.037567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.037719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.037996 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.038253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.038543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.038815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.039081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.039351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.039613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.040753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.041027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.041303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.041603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.041880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.042135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.042428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.042700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.042961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.043226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.043486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.066053 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.067952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.068230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.070050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.071683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.071961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.074029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.074443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.074730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.077744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.078138 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.078439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.082003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.082284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.085951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.086294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.086791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.087078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.087375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.087633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.087902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.088172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.088492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.089248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.091367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.091653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.091930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.092206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.092476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.092744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.093010 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.093276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.108012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.108289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.112062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.112334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.112830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.116491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.116876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.117005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.121042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.121433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.122425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.126008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.126579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.129906 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.130194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.130344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.130500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.130769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.131034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.131308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.133951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.134246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.134550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.134841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.135110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.136444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.151005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.151284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.151550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.151812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.155399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.155676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.155937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.156203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.159715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.161427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.161706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.164059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.165751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.166030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.166241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.168138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.168138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.168138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.168138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.170670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.170952 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.171248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.171531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.171804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.180692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.180969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.181270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.181547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.181917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.182755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.183036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.185494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.185771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.186120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.186414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.186789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.187063 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.187335 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.201869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.205173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.206713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.208499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.209963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.210219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.211894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.212194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.212486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.213450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.215301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.216931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.217206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.217577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.219836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.221455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.224729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.224873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.225014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.225392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.225667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.226506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.229748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.230033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.230432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.230707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.234883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.235165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.235444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.240090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.240382 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.240656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.243387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.243621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.243895 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.244165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.244442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.245356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.245634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.245913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.246190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.246485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.246755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.247022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.247287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.247546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.248996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86897) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 18:35:46.249270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.249545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.249830 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.250098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.250508 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.250782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.251054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.251328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.251595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.251860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.252127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.252399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.252656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86897) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 18:35:46.285640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5563b0f7f9c0 pid: 86898 (default app) Jun 16 18:35:46.289093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b806b0-e186-4adf-b72f-4acc08776ae3 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:46.289396 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b806b0-e186-4adf-b72f-4acc08776ae3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:46.289675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b806b0-e186-4adf-b72f-4acc08776ae3 None None] PATH_INFO: `/v3` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:46.290903 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5563b0f7f9c0 pid: 86897 (default app) Jun 16 18:35:46.293935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Thu Jun 16 18:35:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:35:54.082571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ad7c9-4c31-4b0f-9d66-707f6627b559 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:54.083171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ad7c9-4c31-4b0f-9d66-707f6627b559 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:54.083171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ad7c9-4c31-4b0f-9d66-707f6627b559 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:54.088531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:35:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:35:54.094512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:54.095021 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:54.095110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:54.165415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: INFO dbcounter [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] Registered counter for database keystone Jun 16 18:35:54.187692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG oslo_db.sqlalchemy.engines [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:35:54.194357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writer thread running {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:35:54.375025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG passlib.handlers.bcrypt [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86898) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 18:35:54.375361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG passlib.handlers.bcrypt [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86898) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 18:35:54.430117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:35:54.432257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:35:54.556520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:35:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 18:35:54.691211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ad7c9-4c31-4b0f-9d66-707f6627b559 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:35:54.761703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: INFO dbcounter [None req-5a4ad7c9-4c31-4b0f-9d66-707f6627b559 None None] Registered counter for database keystone Jun 16 18:35:54.781363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG oslo_db.sqlalchemy.engines [None req-5a4ad7c9-4c31-4b0f-9d66-707f6627b559 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:35:54.787578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writer thread running {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:35:54.907386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ad7c9-4c31-4b0f-9d66-707f6627b559 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:35:54.911690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a081b-1632-4e18-813d-59046164b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:35:54.912355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a081b-1632-4e18-813d-59046164b7be admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:54.912641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a081b-1632-4e18-813d-59046164b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:54.912921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a081b-1632-4e18-813d-59046164b7be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:54.921269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a081b-1632-4e18-813d-59046164b7be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:35:54.973118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING keystone.common.rbac_enforcer.enforcer [None req-488a081b-1632-4e18-813d-59046164b7be admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 18:35:54.973457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a081b-1632-4e18-813d-59046164b7be admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:35:54.983557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Jun 16 18:35:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:54.989502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:35:55.006347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6ef64-7f16-425d-8bc0-4b2d06964a82 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:35:55.011393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2333779-aae4-4140-b6a3-74825ca24998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:35:55.013587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2333779-aae4-4140-b6a3-74825ca24998 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:55.013587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2333779-aae4-4140-b6a3-74825ca24998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:55.013587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2333779-aae4-4140-b6a3-74825ca24998 admin admin] PATH_INFO: `/v3/projects/9b921b8affc14177a85b3aac3f02deca` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:55.015809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2333779-aae4-4140-b6a3-74825ca24998 admin admin] RBAC: Authorizing `identity:get_project(project_id=9b921b8affc14177a85b3aac3f02deca)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:35:55.064887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c2333779-aae4-4140-b6a3-74825ca24998 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 18:35:55.065226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2333779-aae4-4140-b6a3-74825ca24998 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:35:55.070035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Thu Jun 16 18:35:54 2022] GET /identity/v3/projects/9b921b8affc14177a85b3aac3f02deca => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:35:57.187295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436440-9589-40a6-bfa7-7da18ab1f6a4 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:57.187816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436440-9589-40a6-bfa7-7da18ab1f6a4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:57.187917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436440-9589-40a6-bfa7-7da18ab1f6a4 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:57.192216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:35:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:35:57.197990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4a3d-2046-480c-a705-0bceec678891 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:57.198359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4a3d-2046-480c-a705-0bceec678891 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:57.198577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4a3d-2046-480c-a705-0bceec678891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:57.217646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-326f4a3d-2046-480c-a705-0bceec678891 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:35:57.219209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-326f4a3d-2046-480c-a705-0bceec678891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:35:57.227180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:35:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 18:35:57.249537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1436440-9589-40a6-bfa7-7da18ab1f6a4 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:35:57.262173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1436440-9589-40a6-bfa7-7da18ab1f6a4 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:35:57.266424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2aa3bd-b082-4662-9929-c81b3cbbcd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:35:57.267062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa3bd-b082-4662-9929-c81b3cbbcd5d admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:57.267348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa3bd-b082-4662-9929-c81b3cbbcd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:57.267627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa3bd-b082-4662-9929-c81b3cbbcd5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:57.275905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2aa3bd-b082-4662-9929-c81b3cbbcd5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:35:57.277676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2aa3bd-b082-4662-9929-c81b3cbbcd5d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:35:57.286428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Jun 16 18:35:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:57.291817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f4a3d-2046-480c-a705-0bceec678891 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:35:57.300868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f4a3d-2046-480c-a705-0bceec678891 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:35:57.305300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5622c-2869-467f-8fa9-96d9b470b334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:35:57.306162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5622c-2869-467f-8fa9-96d9b470b334 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:57.306474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5622c-2869-467f-8fa9-96d9b470b334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:57.306751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5622c-2869-467f-8fa9-96d9b470b334 admin admin] PATH_INFO: `/v3/users/d16970c992ef45ad92a1879619e5cda1` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:57.308149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5622c-2869-467f-8fa9-96d9b470b334 admin admin] RBAC: Authorizing `identity:get_user(user_id=d16970c992ef45ad92a1879619e5cda1)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:35:57.309988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5622c-2869-467f-8fa9-96d9b470b334 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:35:57.311592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Thu Jun 16 18:35:57 2022] GET /identity/v3/users/d16970c992ef45ad92a1879619e5cda1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:35:59.490967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79b49a-ccaf-4666-8a19-097b374111a2 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:59.491530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79b49a-ccaf-4666-8a19-097b374111a2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:59.491530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79b49a-ccaf-4666-8a19-097b374111a2 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:59.493444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:35:59.499188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668ae6c-9a4c-4f05-8a9c-b962a2260a57 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:59.499658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668ae6c-9a4c-4f05-8a9c-b962a2260a57 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:59.499751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668ae6c-9a4c-4f05-8a9c-b962a2260a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:59.517625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-b668ae6c-9a4c-4f05-8a9c-b962a2260a57 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:35:59.518854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b668ae6c-9a4c-4f05-8a9c-b962a2260a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:35:59.531469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69ee45-ade7-49f2-8505-c549716d9383 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:59.531754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69ee45-ade7-49f2-8505-c549716d9383 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:59.532032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69ee45-ade7-49f2-8505-c549716d9383 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:59.533389 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:35:59.539034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05705a0a-da0c-4938-baa1-4ac2d452ab23 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:59.539321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05705a0a-da0c-4938-baa1-4ac2d452ab23 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:59.539600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05705a0a-da0c-4938-baa1-4ac2d452ab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:59.580189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG passlib.handlers.bcrypt [None req-05705a0a-da0c-4938-baa1-4ac2d452ab23 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86897) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 18:35:59.580590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG passlib.handlers.bcrypt [None req-05705a0a-da0c-4938-baa1-4ac2d452ab23 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86897) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 18:35:59.603342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:35:59.626520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668ae6c-9a4c-4f05-8a9c-b962a2260a57 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:35:59.626934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-05705a0a-da0c-4938-baa1-4ac2d452ab23 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:35:59.628542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-05705a0a-da0c-4938-baa1-4ac2d452ab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:35:59.650897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:59.733141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668ae6c-9a4c-4f05-8a9c-b962a2260a57 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:35:59.733882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:35:59.756764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05705a0a-da0c-4938-baa1-4ac2d452ab23 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:35:59.772350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1d554-7b03-4e8a-af05-3baad14439d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:35:59.773161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d554-7b03-4e8a-af05-3baad14439d9 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:59.773448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d554-7b03-4e8a-af05-3baad14439d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:59.773729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d554-7b03-4e8a-af05-3baad14439d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:59.785519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1d554-7b03-4e8a-af05-3baad14439d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-c9b1d554-7b03-4e8a-af05-3baad14439d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:35:59.796856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:35:59.797733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:35:59.798812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:35:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:35:59.803829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1d554-7b03-4e8a-af05-3baad14439d9 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:35:59.856956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05705a0a-da0c-4938-baa1-4ac2d452ab23 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:35:59.859290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:59.886925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:59.897579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca5cf-bc17-4c43-a3d5-0084fac895d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:35:59.898565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca5cf-bc17-4c43-a3d5-0084fac895d8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:59.898855 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca5cf-bc17-4c43-a3d5-0084fac895d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:59.899130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca5cf-bc17-4c43-a3d5-0084fac895d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:59.905608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1d554-7b03-4e8a-af05-3baad14439d9 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:35:59.941356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09816fb-7925-45b6-9d75-983aeaf1e469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:35:59.942037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09816fb-7925-45b6-9d75-983aeaf1e469 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:35:59.942324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09816fb-7925-45b6-9d75-983aeaf1e469 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:35:59.942635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09816fb-7925-45b6-9d75-983aeaf1e469 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:35:59.943398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09816fb-7925-45b6-9d75-983aeaf1e469 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:35:59.943706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09816fb-7925-45b6-9d75-983aeaf1e469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:35:59.945154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09816fb-7925-45b6-9d75-983aeaf1e469 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:35:59.957657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:35:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:35:59.963257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09816fb-7925-45b6-9d75-983aeaf1e469 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:35:59.968267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca5cf-bc17-4c43-a3d5-0084fac895d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:35:59.969842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca5cf-bc17-4c43-a3d5-0084fac895d8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:00.064876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09816fb-7925-45b6-9d75-983aeaf1e469 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:00.069702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:00.075755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca5cf-bc17-4c43-a3d5-0084fac895d8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:00.078480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:00.100695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a96804-581b-4aa4-b929-1b3f8c5d2f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:00.101631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96804-581b-4aa4-b929-1b3f8c5d2f93 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:00.101914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96804-581b-4aa4-b929-1b3f8c5d2f93 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:00.102189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96804-581b-4aa4-b929-1b3f8c5d2f93 None admin] PATH_INFO: `/v3/users/d16970c992ef45ad92a1879619e5cda1` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:00.103437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a96804-581b-4aa4-b929-1b3f8c5d2f93 None admin] RBAC: Authorizing `identity:get_user(user_id=d16970c992ef45ad92a1879619e5cda1)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:00.104897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a96804-581b-4aa4-b929-1b3f8c5d2f93 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:00.106559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:35:59 2022] GET /identity/v3/users/d16970c992ef45ad92a1879619e5cda1 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:00.112016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a96804-581b-4aa4-b929-1b3f8c5d2f93 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:00.126570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:00.177529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca5cf-bc17-4c43-a3d5-0084fac895d8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:00.211639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07577d05-f1b9-4f2a-b2f3-e39118795a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:00.212434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07577d05-f1b9-4f2a-b2f3-e39118795a22 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:00.212713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07577d05-f1b9-4f2a-b2f3-e39118795a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:00.212981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07577d05-f1b9-4f2a-b2f3-e39118795a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:00.216116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a96804-581b-4aa4-b929-1b3f8c5d2f93 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:00.232399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07577d05-f1b9-4f2a-b2f3-e39118795a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:00.233869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07577d05-f1b9-4f2a-b2f3-e39118795a22 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:00.250510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a9eca-0ab0-489f-ae9e-9d382ef53ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:00.251311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9eca-0ab0-489f-ae9e-9d382ef53ae1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:00.251601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9eca-0ab0-489f-ae9e-9d382ef53ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:00.251880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9eca-0ab0-489f-ae9e-9d382ef53ae1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:00.253089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a9eca-0ab0-489f-ae9e-9d382ef53ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:00.254627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a9eca-0ab0-489f-ae9e-9d382ef53ae1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-07577d05-f1b9-4f2a-b2f3-e39118795a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:36:00.255733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:00.256563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:00.257339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:36:00.257339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:36:00.257339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:36:00.257339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:00.258049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 10/18] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:00.258119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 9/19] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:00.262666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a9eca-0ab0-489f-ae9e-9d382ef53ae1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:00.262964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07577d05-f1b9-4f2a-b2f3-e39118795a22 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:00.322210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:00.346186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:00.365533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a9eca-0ab0-489f-ae9e-9d382ef53ae1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:00.366680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07577d05-f1b9-4f2a-b2f3-e39118795a22 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:00.401366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c13962-5a4d-4b7c-923f-90b579c5eeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:00.402024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c13962-5a4d-4b7c-923f-90b579c5eeb1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:00.402302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c13962-5a4d-4b7c-923f-90b579c5eeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:00.402480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b7cb6-cf82-4451-9380-27d078cc0283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:00.402595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c13962-5a4d-4b7c-923f-90b579c5eeb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:00.403146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b7cb6-cf82-4451-9380-27d078cc0283 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:00.403428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c13962-5a4d-4b7c-923f-90b579c5eeb1 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.domain.id=default, user.id=d16970c992ef45ad92a1879619e5cda1) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:00.403519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b7cb6-cf82-4451-9380-27d078cc0283 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:00.403705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b7cb6-cf82-4451-9380-27d078cc0283 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:00.403785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c13962-5a4d-4b7c-923f-90b579c5eeb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:00.404430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b7cb6-cf82-4451-9380-27d078cc0283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:00.404740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b7cb6-cf82-4451-9380-27d078cc0283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:00.405161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c13962-5a4d-4b7c-923f-90b579c5eeb1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:00.406110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b7cb6-cf82-4451-9380-27d078cc0283 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:00.412075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 11/20] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Jun 16 18:36:00 2022] GET /identity/v3/role_assignments?user.id=d16970c992ef45ad92a1879619e5cda1&scope.domain.id=default&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:00.425308 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 10/21] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:02.929780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfcd53-27d6-4faa-aecc-b6f81dd7d2eb None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:02.930635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfcd53-27d6-4faa-aecc-b6f81dd7d2eb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:02.931147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfcd53-27d6-4faa-aecc-b6f81dd7d2eb None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:02.932967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 12/22] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:02.938024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1a3b-f68b-4acf-867b-435f04743fae None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:02.939124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1a3b-f68b-4acf-867b-435f04743fae None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:02.939542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1a3b-f68b-4acf-867b-435f04743fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:02.963413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-80ad1a3b-f68b-4acf-867b-435f04743fae None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:02.964863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-80ad1a3b-f68b-4acf-867b-435f04743fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:03.062559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 11/23] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:03.098272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfcd53-27d6-4faa-aecc-b6f81dd7d2eb None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:03.142978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8003e1-f52c-4614-bbec-023de812a5e1 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.144654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8003e1-f52c-4614-bbec-023de812a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.145858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8003e1-f52c-4614-bbec-023de812a5e1 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.147815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 12/24] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:03.153737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4bee0-01a2-492a-af67-8e9081b96d6c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.154418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4bee0-01a2-492a-af67-8e9081b96d6c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.154937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4bee0-01a2-492a-af67-8e9081b96d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.185167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-75e4bee0-01a2-492a-af67-8e9081b96d6c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:03.186724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-75e4bee0-01a2-492a-af67-8e9081b96d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:03.262765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:03.300056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfcd53-27d6-4faa-aecc-b6f81dd7d2eb None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:03.309103 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:03.346791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4bee0-01a2-492a-af67-8e9081b96d6c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:03.365962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88dee3-1b65-40f7-89df-f676987a0b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:03.367361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88dee3-1b65-40f7-89df-f676987a0b6a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.367643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88dee3-1b65-40f7-89df-f676987a0b6a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.367918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88dee3-1b65-40f7-89df-f676987a0b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.390430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88dee3-1b65-40f7-89df-f676987a0b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:03.390430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88dee3-1b65-40f7-89df-f676987a0b6a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:03.391385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-4b88dee3-1b65-40f7-89df-f676987a0b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:36:03.415485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:03.416377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:03.417163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:36:03.417163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:36:03.417163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:36:03.417163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:03.419174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 13/26] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:03.427710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88dee3-1b65-40f7-89df-f676987a0b6a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:03.538057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4bee0-01a2-492a-af67-8e9081b96d6c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:03.592929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1ccda-25aa-4d34-be6c-e84810e6e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:03.594007 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1ccda-25aa-4d34-be6c-e84810e6e973 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.596892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1ccda-25aa-4d34-be6c-e84810e6e973 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.597346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1ccda-25aa-4d34-be6c-e84810e6e973 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.598251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1ccda-25aa-4d34-be6c-e84810e6e973 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:03.599833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1ccda-25aa-4d34-be6c-e84810e6e973 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:03.655519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88dee3-1b65-40f7-89df-f676987a0b6a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:03.692110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e4567-ac7b-4eef-85c3-9345d7411d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:03.693059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e4567-ac7b-4eef-85c3-9345d7411d22 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.693578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e4567-ac7b-4eef-85c3-9345d7411d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.694066 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e4567-ac7b-4eef-85c3-9345d7411d22 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.695039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e4567-ac7b-4eef-85c3-9345d7411d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:03.695488 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e4567-ac7b-4eef-85c3-9345d7411d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:03.697137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e4567-ac7b-4eef-85c3-9345d7411d22 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:03.718135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 14/27] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:03.720020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496495-61b5-4fec-be5f-8dd843e74f97 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.720544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496495-61b5-4fec-be5f-8dd843e74f97 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.720989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98496495-61b5-4fec-be5f-8dd843e74f97 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.722882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 15/28] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:03.724221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ad0ba-38e9-4c15-a287-33e8085891e8 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.724740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ad0ba-38e9-4c15-a287-33e8085891e8 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.725182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ad0ba-38e9-4c15-a287-33e8085891e8 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.732212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 16/29] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:03.733374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ad0ba-38e9-4c15-a287-33e8085891e8 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:03.751347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 14/30] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jun 16 18:36:03 2022] POST /identity/v3/roles => generated 219 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:03.753365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0085e1-f121-4841-baa0-beadc038ef28 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.753878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0085e1-f121-4841-baa0-beadc038ef28 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.754336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0085e1-f121-4841-baa0-beadc038ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.777877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-bc0085e1-f121-4841-baa0-beadc038ef28 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:03.779528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bc0085e1-f121-4841-baa0-beadc038ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:03.823280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:03.826818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:03.895472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ad0ba-38e9-4c15-a287-33e8085891e8 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:03.923893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 15/31] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:03.925271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9582ca-a75e-42fa-a6a4-6f6075054ab0 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.925827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9582ca-a75e-42fa-a6a4-6f6075054ab0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.926271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9582ca-a75e-42fa-a6a4-6f6075054ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.939508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bd752-e147-468d-93aa-dc62252af52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:03.940780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bd752-e147-468d-93aa-dc62252af52f None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:03.941211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bd752-e147-468d-93aa-dc62252af52f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:03.941631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bd752-e147-468d-93aa-dc62252af52f None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:03.942580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bd752-e147-468d-93aa-dc62252af52f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:03.944259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bd752-e147-468d-93aa-dc62252af52f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:03.968183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4f9582ca-a75e-42fa-a6a4-6f6075054ab0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:03.970126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4f9582ca-a75e-42fa-a6a4-6f6075054ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:04.058598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 16/32] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:04.059839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9582ca-a75e-42fa-a6a4-6f6075054ab0 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:04.188571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:04.199553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9582ca-a75e-42fa-a6a4-6f6075054ab0 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:04.221586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 17/33] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:36:03 2022] POST /identity/v3/projects => generated 301 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:04.223194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bd752-e147-468d-93aa-dc62252af52f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:04.264753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5478c0-8691-4b4b-8842-306649bd3642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:04.265768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5478c0-8691-4b4b-8842-306649bd3642 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.266148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5478c0-8691-4b4b-8842-306649bd3642 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.266562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5478c0-8691-4b4b-8842-306649bd3642 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.281518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5478c0-8691-4b4b-8842-306649bd3642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-0b5478c0-8691-4b4b-8842-306649bd3642 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:04.291900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:04.292798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:04.293526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:04.300012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 17/34] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:04.302938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5478c0-8691-4b4b-8842-306649bd3642 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:04.349309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bd752-e147-468d-93aa-dc62252af52f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:04.360952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:04.392806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0d2c3-bfc5-4652-9dc7-071469dda7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:04.393508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0d2c3-bfc5-4652-9dc7-071469dda7f9 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.393794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0d2c3-bfc5-4652-9dc7-071469dda7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.394074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0d2c3-bfc5-4652-9dc7-071469dda7f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.394925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0d2c3-bfc5-4652-9dc7-071469dda7f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:04.396555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0d2c3-bfc5-4652-9dc7-071469dda7f9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:04.436452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 18/35] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jun 16 18:36:04 2022] POST /identity/v3/roles => generated 225 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:04.548157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfbcc0-6d8c-4b8f-a4a4-f6bd08689967 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.548441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfbcc0-6d8c-4b8f-a4a4-f6bd08689967 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.548729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfbcc0-6d8c-4b8f-a4a4-f6bd08689967 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.550125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:04.556085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d45f24-7170-48df-9ff4-9b1a2e62e88c None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.556734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d45f24-7170-48df-9ff4-9b1a2e62e88c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.557286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d45f24-7170-48df-9ff4-9b1a2e62e88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.559996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5478c0-8691-4b4b-8842-306649bd3642 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:04.582080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-46d45f24-7170-48df-9ff4-9b1a2e62e88c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:04.584315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-46d45f24-7170-48df-9ff4-9b1a2e62e88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:04.604165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d12b6b-21a7-47a7-9f4b-aa7437d78afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:04.604791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d12b6b-21a7-47a7-9f4b-aa7437d78afd None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.605232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d12b6b-21a7-47a7-9f4b-aa7437d78afd None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.605653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d12b6b-21a7-47a7-9f4b-aa7437d78afd None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.606625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d12b6b-21a7-47a7-9f4b-aa7437d78afd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:04.607090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d12b6b-21a7-47a7-9f4b-aa7437d78afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:04.608954 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d12b6b-21a7-47a7-9f4b-aa7437d78afd None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:04.624061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 18/37] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:04.629782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d12b6b-21a7-47a7-9f4b-aa7437d78afd None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:04.653431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:04.673174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 20/38] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:04.675837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9096d-881e-4040-a978-ac2132ae2c60 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.676422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9096d-881e-4040-a978-ac2132ae2c60 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.676894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9096d-881e-4040-a978-ac2132ae2c60 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.679546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 21/39] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:04.684859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4810dc-ab41-47c6-ae67-5e9c865fe17a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.685197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4810dc-ab41-47c6-ae67-5e9c865fe17a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.685423 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4810dc-ab41-47c6-ae67-5e9c865fe17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.705313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-8f4810dc-ab41-47c6-ae67-5e9c865fe17a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:04.706750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8f4810dc-ab41-47c6-ae67-5e9c865fe17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:04.752750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d12b6b-21a7-47a7-9f4b-aa7437d78afd None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:04.781905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 22/40] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:04.782576 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4810dc-ab41-47c6-ae67-5e9c865fe17a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:04.788260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16570e4a-2291-4606-a666-ad51b54813dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:04.789150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16570e4a-2291-4606-a666-ad51b54813dd None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.789430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16570e4a-2291-4606-a666-ad51b54813dd None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.789703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16570e4a-2291-4606-a666-ad51b54813dd None admin] PATH_INFO: `/v3/users/d16970c992ef45ad92a1879619e5cda1` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.791386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16570e4a-2291-4606-a666-ad51b54813dd None admin] RBAC: Authorizing `identity:get_user(user_id=d16970c992ef45ad92a1879619e5cda1)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:04.792849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16570e4a-2291-4606-a666-ad51b54813dd None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:04.794675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 19/41] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:04 2022] GET /identity/v3/users/d16970c992ef45ad92a1879619e5cda1 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:04.799900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16570e4a-2291-4606-a666-ad51b54813dd None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:04.811555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:04.886454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:04.887070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4810dc-ab41-47c6-ae67-5e9c865fe17a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:04.901938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16570e4a-2291-4606-a666-ad51b54813dd None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:04.920817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1420b-c213-49e5-b5fc-66fcc98cb6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:04.921488 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1420b-c213-49e5-b5fc-66fcc98cb6ef None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.921777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1420b-c213-49e5-b5fc-66fcc98cb6ef None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.922060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1420b-c213-49e5-b5fc-66fcc98cb6ef None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.922858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1420b-c213-49e5-b5fc-66fcc98cb6ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:04.924276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1420b-c213-49e5-b5fc-66fcc98cb6ef None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:04.937926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 23/42] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jun 16 18:36:04 2022] POST /identity/v3/roles => generated 223 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:04.938532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d20940-1876-4d6a-89f9-5074aef88db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:04.939054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1420b-c213-49e5-b5fc-66fcc98cb6ef None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:04.939605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20940-1876-4d6a-89f9-5074aef88db2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:04.939880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20940-1876-4d6a-89f9-5074aef88db2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:04.940158 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d20940-1876-4d6a-89f9-5074aef88db2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:04.941406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d20940-1876-4d6a-89f9-5074aef88db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:04.943056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d20940-1876-4d6a-89f9-5074aef88db2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:04.945336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 20/43] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:04.951411 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d20940-1876-4d6a-89f9-5074aef88db2 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:05.057909 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:05.075156 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1420b-c213-49e5-b5fc-66fcc98cb6ef None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:05.075400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d20940-1876-4d6a-89f9-5074aef88db2 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:05.115986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259417-9b22-4fb0-92a0-1374f5e0619d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:05.117507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259417-9b22-4fb0-92a0-1374f5e0619d None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:05.117695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259417-9b22-4fb0-92a0-1374f5e0619d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:05.117975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259417-9b22-4fb0-92a0-1374f5e0619d None admin] PATH_INFO: `/v3/domains/default/users/d16970c992ef45ad92a1879619e5cda1/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:05.119614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf3571-a307-4747-b888-64776707d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:05.120623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf3571-a307-4747-b888-64776707d207 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:05.120923 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf3571-a307-4747-b888-64776707d207 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:05.121083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c259417-9b22-4fb0-92a0-1374f5e0619d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d16970c992ef45ad92a1879619e5cda1, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:05.121191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf3571-a307-4747-b888-64776707d207 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:05.122924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf3571-a307-4747-b888-64776707d207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:05.123038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c259417-9b22-4fb0-92a0-1374f5e0619d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:05.123941 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf3571-a307-4747-b888-64776707d207 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:05.125893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 24/44] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:05.131349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf3571-a307-4747-b888-64776707d207 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:05.141389 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 21/45] 10.222.0.40 () {58 vars in 1361 bytes} [Thu Jun 16 18:36:04 2022] PUT /identity/v3/domains/default/users/d16970c992ef45ad92a1879619e5cda1/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:36:05.247963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf3571-a307-4747-b888-64776707d207 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:05.283676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479416d2-39e5-44c1-a3ba-880a4acd7846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:05.284361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479416d2-39e5-44c1-a3ba-880a4acd7846 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:05.284646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479416d2-39e5-44c1-a3ba-880a4acd7846 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:05.284921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479416d2-39e5-44c1-a3ba-880a4acd7846 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:05.285646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479416d2-39e5-44c1-a3ba-880a4acd7846 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:05.287167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479416d2-39e5-44c1-a3ba-880a4acd7846 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:05.316590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 25/46] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:36:05 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:07.264515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99276-a744-45db-a9d3-49ebc4238699 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.265033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99276-a744-45db-a9d3-49ebc4238699 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.265113 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99276-a744-45db-a9d3-49ebc4238699 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.266595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 22/47] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:07.271490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e332a47-9401-48ad-bcc8-7921e1470a9d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.271857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e332a47-9401-48ad-bcc8-7921e1470a9d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.272095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e332a47-9401-48ad-bcc8-7921e1470a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.288460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-1e332a47-9401-48ad-bcc8-7921e1470a9d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:07.289641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1e332a47-9401-48ad-bcc8-7921e1470a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:07.291664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:07.356453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 26/48] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:07.379581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab99276-a744-45db-a9d3-49ebc4238699 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:07.396079 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:07.475615 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df9485-4292-4d28-91c6-eaedfe9f306a None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.475903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df9485-4292-4d28-91c6-eaedfe9f306a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.476185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df9485-4292-4d28-91c6-eaedfe9f306a None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.477565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 27/49] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:07.482463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e846ae-bceb-40a5-9860-f17301705c62 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.482754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e846ae-bceb-40a5-9860-f17301705c62 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.483037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e846ae-bceb-40a5-9860-f17301705c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.487900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab99276-a744-45db-a9d3-49ebc4238699 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:07.500563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-97e846ae-bceb-40a5-9860-f17301705c62 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:07.501772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-97e846ae-bceb-40a5-9860-f17301705c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:07.524616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8815b7-fd5b-4d17-b22d-0c7c791f69f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:07.525356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8815b7-fd5b-4d17-b22d-0c7c791f69f0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.525636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8815b7-fd5b-4d17-b22d-0c7c791f69f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.525914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8815b7-fd5b-4d17-b22d-0c7c791f69f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.536761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8815b7-fd5b-4d17-b22d-0c7c791f69f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-ce8815b7-fd5b-4d17-b22d-0c7c791f69f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:07.544899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:07.545795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:07.546592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 23/50] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:07.551671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8815b7-fd5b-4d17-b22d-0c7c791f69f0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:07.572881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 28/51] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:07.595424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e846ae-bceb-40a5-9860-f17301705c62 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:07.627163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:07.652047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8815b7-fd5b-4d17-b22d-0c7c791f69f0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:07.659774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:07.686006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323b14a-919f-4d44-b8b9-11b2c60865a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:07.686715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323b14a-919f-4d44-b8b9-11b2c60865a1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.687006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323b14a-919f-4d44-b8b9-11b2c60865a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.687291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323b14a-919f-4d44-b8b9-11b2c60865a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.688302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323b14a-919f-4d44-b8b9-11b2c60865a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:07.688615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323b14a-919f-4d44-b8b9-11b2c60865a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:07.690008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323b14a-919f-4d44-b8b9-11b2c60865a1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:07.694100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e846ae-bceb-40a5-9860-f17301705c62 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:07.698231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 24/52] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:07.703649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323b14a-919f-4d44-b8b9-11b2c60865a1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:07.727603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1a8d8-a033-411a-a538-ccad63281255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:07.728397 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1a8d8-a033-411a-a538-ccad63281255 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.728737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1a8d8-a033-411a-a538-ccad63281255 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.729022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1a8d8-a033-411a-a538-ccad63281255 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.730206 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1a8d8-a033-411a-a538-ccad63281255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:07.731686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1a8d8-a033-411a-a538-ccad63281255 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:07.733587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 29/53] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:07.738647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1a8d8-a033-411a-a538-ccad63281255 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:07.803351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323b14a-919f-4d44-b8b9-11b2c60865a1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:07.836792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b48ee4-e839-44f7-9b0c-1f1de8e7646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:07.837666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b48ee4-e839-44f7-9b0c-1f1de8e7646a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.837954 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b48ee4-e839-44f7-9b0c-1f1de8e7646a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.838234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b48ee4-e839-44f7-9b0c-1f1de8e7646a None admin] PATH_INFO: `/v3/users/d16970c992ef45ad92a1879619e5cda1` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.839455 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b48ee4-e839-44f7-9b0c-1f1de8e7646a None admin] RBAC: Authorizing `identity:get_user(user_id=d16970c992ef45ad92a1879619e5cda1)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:07.839894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1a8d8-a033-411a-a538-ccad63281255 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:07.840905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b48ee4-e839-44f7-9b0c-1f1de8e7646a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:07.842555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 25/54] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:07 2022] GET /identity/v3/users/d16970c992ef45ad92a1879619e5cda1 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:07.848774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b48ee4-e839-44f7-9b0c-1f1de8e7646a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:07.852589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:07.874304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd4f6-f59d-42f4-967d-5faed245f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:07.875012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd4f6-f59d-42f4-967d-5faed245f8e4 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.875301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd4f6-f59d-42f4-967d-5faed245f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.875580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd4f6-f59d-42f4-967d-5faed245f8e4 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.876296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bd4f6-f59d-42f4-967d-5faed245f8e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:07.877749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bd4f6-f59d-42f4-967d-5faed245f8e4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:07.882337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:07.903412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 30/55] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Jun 16 18:36:07 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:07.955020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b48ee4-e839-44f7-9b0c-1f1de8e7646a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:07.991421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7f566-d163-4e03-9ebe-e58597b16878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:07.992236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7f566-d163-4e03-9ebe-e58597b16878 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:07.992527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7f566-d163-4e03-9ebe-e58597b16878 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:07.992810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7f566-d163-4e03-9ebe-e58597b16878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:07.994035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7f566-d163-4e03-9ebe-e58597b16878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:07.995559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7f566-d163-4e03-9ebe-e58597b16878 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:07.997241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 26/56] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:08.003311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd4f6-f59d-42f4-967d-5faed245f8e4 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:08.109898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd4f6-f59d-42f4-967d-5faed245f8e4 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:08.143784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f6c7b-1575-4a1a-a59d-7ed2607a56f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:08.144442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f6c7b-1575-4a1a-a59d-7ed2607a56f3 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:08.144730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f6c7b-1575-4a1a-a59d-7ed2607a56f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:08.145012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f6c7b-1575-4a1a-a59d-7ed2607a56f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:08.145848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f6c7b-1575-4a1a-a59d-7ed2607a56f3 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.domain.id=default, user.id=d16970c992ef45ad92a1879619e5cda1) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:08.146166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f6c7b-1575-4a1a-a59d-7ed2607a56f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:08.147652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f6c7b-1575-4a1a-a59d-7ed2607a56f3 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:08.153390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 31/57] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Jun 16 18:36:08 2022] GET /identity/v3/role_assignments?user.id=d16970c992ef45ad92a1879619e5cda1&scope.domain.id=default&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:10.012621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0944-8e19-40d0-99fb-8a5a43b48ceb None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:10.013171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0944-8e19-40d0-99fb-8a5a43b48ceb None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:10.013171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c0944-8e19-40d0-99fb-8a5a43b48ceb None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:10.014574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 27/58] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:10.019759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847bbf6-334f-4ca8-bc2b-74613d4969ef None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:10.020284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847bbf6-334f-4ca8-bc2b-74613d4969ef None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:10.020433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847bbf6-334f-4ca8-bc2b-74613d4969ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:10.036683 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d847bbf6-334f-4ca8-bc2b-74613d4969ef None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:10.038427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d847bbf6-334f-4ca8-bc2b-74613d4969ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:10.083665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:10.103819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:10.128501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c0944-8e19-40d0-99fb-8a5a43b48ceb None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:10.199393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:10.230988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c0944-8e19-40d0-99fb-8a5a43b48ceb None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:10.263075 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298539a-6234-4286-a764-0889b0926856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:10.263802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298539a-6234-4286-a764-0889b0926856 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:10.264088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298539a-6234-4286-a764-0889b0926856 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:10.264368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298539a-6234-4286-a764-0889b0926856 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:10.265537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298539a-6234-4286-a764-0889b0926856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:10.267028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298539a-6234-4286-a764-0889b0926856 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:10.268630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 28/60] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:10.274715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847bbf6-334f-4ca8-bc2b-74613d4969ef None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:10.372446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847bbf6-334f-4ca8-bc2b-74613d4969ef None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:10.408366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4de66a-69dd-4733-9347-85ce90f4cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:10.409506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4de66a-69dd-4733-9347-85ce90f4cef5 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:10.410026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4de66a-69dd-4733-9347-85ce90f4cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:10.410577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4de66a-69dd-4733-9347-85ce90f4cef5 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:10.411937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4de66a-69dd-4733-9347-85ce90f4cef5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:10.415301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4de66a-69dd-4733-9347-85ce90f4cef5 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:10.441969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 33/61] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:10 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:13.577610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab35c7-2ecf-4f95-b669-8853a62b7506 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:13.578108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab35c7-2ecf-4f95-b669-8853a62b7506 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:13.578179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab35c7-2ecf-4f95-b669-8853a62b7506 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:13.579799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 29/62] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:13.585877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4417-0e20-4d39-9e75-410a4ef2cc06 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:13.586760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4417-0e20-4d39-9e75-410a4ef2cc06 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:13.587237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4417-0e20-4d39-9e75-410a4ef2cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:13.615456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-648c4417-0e20-4d39-9e75-410a4ef2cc06 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:13.616677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-648c4417-0e20-4d39-9e75-410a4ef2cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:13.651430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:13.701264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 34/63] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:13.736150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab35c7-2ecf-4f95-b669-8853a62b7506 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:13.906307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab35c7-2ecf-4f95-b669-8853a62b7506 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:13.951173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fa1d1-932c-4c9b-b5ff-79d08c3818fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:13.951983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fa1d1-932c-4c9b-b5ff-79d08c3818fc None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:13.952270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fa1d1-932c-4c9b-b5ff-79d08c3818fc None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:13.952542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fa1d1-932c-4c9b-b5ff-79d08c3818fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:13.965276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:13.968342 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fa1d1-932c-4c9b-b5ff-79d08c3818fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-a85fa1d1-932c-4c9b-b5ff-79d08c3818fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:13.980993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:13.981866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:13.982657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 30/64] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:13.988051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c4417-0e20-4d39-9e75-410a4ef2cc06 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:13.992156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085349fe-6255-4402-a4cd-bba2a910b7a3 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:13.992447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085349fe-6255-4402-a4cd-bba2a910b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:13.992730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085349fe-6255-4402-a4cd-bba2a910b7a3 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:13.994095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 31/65] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:14.001517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797c562-e328-4d92-a91f-623519867f8b None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.002025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797c562-e328-4d92-a91f-623519867f8b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.002503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797c562-e328-4d92-a91f-623519867f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.027428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b797c562-e328-4d92-a91f-623519867f8b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:14.032644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b797c562-e328-4d92-a91f-623519867f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:14.160969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 32/66] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:14.163345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1d1db-0133-4f73-ac48-0d316f528ce3 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.163796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1d1db-0133-4f73-ac48-0d316f528ce3 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.164153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c4417-0e20-4d39-9e75-410a4ef2cc06 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.164288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1d1db-0133-4f73-ac48-0d316f528ce3 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.165494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 33/67] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:14.171054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b0dc1-4a41-41ca-81cf-4ed402a8d4d4 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.171542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b0dc1-4a41-41ca-81cf-4ed402a8d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.171969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b0dc1-4a41-41ca-81cf-4ed402a8d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.190802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-927b0dc1-4a41-41ca-81cf-4ed402a8d4d4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:14.192249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-927b0dc1-4a41-41ca-81cf-4ed402a8d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:14.206245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce060d-7f3e-4919-b0d3-32c4e3757508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.207154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce060d-7f3e-4919-b0d3-32c4e3757508 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.207394 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce060d-7f3e-4919-b0d3-32c4e3757508 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.207722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce060d-7f3e-4919-b0d3-32c4e3757508 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.209246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce060d-7f3e-4919-b0d3-32c4e3757508 None admin] RBAC: Adding query filter params (name=member) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:14.209607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce060d-7f3e-4919-b0d3-32c4e3757508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:14.211564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce060d-7f3e-4919-b0d3-32c4e3757508 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:14.223318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 35/68] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:14.224902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce060d-7f3e-4919-b0d3-32c4e3757508 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.261644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.278416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 34/69] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:14.278416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b0dc1-4a41-41ca-81cf-4ed402a8d4d4 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.344596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce060d-7f3e-4919-b0d3-32c4e3757508 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.352989 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.378622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56848981-55d8-49b2-b40f-72059ecc838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.379409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56848981-55d8-49b2-b40f-72059ecc838c None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.379694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56848981-55d8-49b2-b40f-72059ecc838c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.379972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56848981-55d8-49b2-b40f-72059ecc838c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.390733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56848981-55d8-49b2-b40f-72059ecc838c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:14.392783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b0dc1-4a41-41ca-81cf-4ed402a8d4d4 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-56848981-55d8-49b2-b40f-72059ecc838c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:14.398865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:14.399712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:14.400446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 36/70] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:14.401268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea54e-c88e-4e58-be8a-2218f8be3899 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.401597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea54e-c88e-4e58-be8a-2218f8be3899 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.401821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea54e-c88e-4e58-be8a-2218f8be3899 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.403334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 37/71] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:14.405254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fea54e-c88e-4e58-be8a-2218f8be3899 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.429172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08538a1-5a11-4b2e-81d3-dc4c2f9ef221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.429984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08538a1-5a11-4b2e-81d3-dc4c2f9ef221 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.430272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08538a1-5a11-4b2e-81d3-dc4c2f9ef221 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.430589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08538a1-5a11-4b2e-81d3-dc4c2f9ef221 None admin] PATH_INFO: `/v3/users/b03aa99594304e7f8e065f8b3ac2b405` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.446217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08538a1-5a11-4b2e-81d3-dc4c2f9ef221 None admin] RBAC: Authorizing `identity:get_user(user_id=b03aa99594304e7f8e065f8b3ac2b405)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:14.447715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08538a1-5a11-4b2e-81d3-dc4c2f9ef221 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:14.449378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 35/72] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/users/b03aa99594304e7f8e065f8b3ac2b405 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:14.450609 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3a5d5-6d5d-4466-9806-6f08642dc78d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.450892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3a5d5-6d5d-4466-9806-6f08642dc78d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.451177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3a5d5-6d5d-4466-9806-6f08642dc78d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.452583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 36/73] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:14.456957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3a5d5-6d5d-4466-9806-6f08642dc78d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.499651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.513674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fea54e-c88e-4e58-be8a-2218f8be3899 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.547566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348afa5-1a9f-4312-949d-1d686f9943bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.548371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348afa5-1a9f-4312-949d-1d686f9943bb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.548654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348afa5-1a9f-4312-949d-1d686f9943bb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.548932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348afa5-1a9f-4312-949d-1d686f9943bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.558939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348afa5-1a9f-4312-949d-1d686f9943bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-8348afa5-1a9f-4312-949d-1d686f9943bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:14.567317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:14.568737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:14.569482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 38/74] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:14.570235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89b5c-c5f8-4ae2-9e0e-845af7f5aeb0 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.570654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89b5c-c5f8-4ae2-9e0e-845af7f5aeb0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.570796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89b5c-c5f8-4ae2-9e0e-845af7f5aeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.574674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3a5d5-6d5d-4466-9806-6f08642dc78d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.587691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-52d89b5c-c5f8-4ae2-9e0e-845af7f5aeb0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:14.588905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-52d89b5c-c5f8-4ae2-9e0e-845af7f5aeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:14.592714 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.610646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0bb34-afdb-46db-a1ed-1740f1616eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.611327 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0bb34-afdb-46db-a1ed-1740f1616eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.611614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0bb34-afdb-46db-a1ed-1740f1616eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.611891 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0bb34-afdb-46db-a1ed-1740f1616eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.612650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0bb34-afdb-46db-a1ed-1740f1616eb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:14.612958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0bb34-afdb-46db-a1ed-1740f1616eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:14.614345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0bb34-afdb-46db-a1ed-1740f1616eb6 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:14.623455 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:14.624245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0bb34-afdb-46db-a1ed-1740f1616eb6 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.660901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 39/76] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:14.664111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d5ed6-2b70-4b05-8db8-58f4d5b749a2 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.664404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d5ed6-2b70-4b05-8db8-58f4d5b749a2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.664680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d5ed6-2b70-4b05-8db8-58f4d5b749a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.680901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-204d5ed6-2b70-4b05-8db8-58f4d5b749a2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:14.682027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-204d5ed6-2b70-4b05-8db8-58f4d5b749a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:14.727717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0bb34-afdb-46db-a1ed-1740f1616eb6 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.747779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 40/77] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:14.748618 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d5ed6-2b70-4b05-8db8-58f4d5b749a2 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.759968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.766272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd32dc-1f0d-42a1-a1e3-353a3344a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.767417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd32dc-1f0d-42a1-a1e3-353a3344a77e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.767850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd32dc-1f0d-42a1-a1e3-353a3344a77e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.768275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd32dc-1f0d-42a1-a1e3-353a3344a77e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.818919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:14.839700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd32dc-1f0d-42a1-a1e3-353a3344a77e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:14.841167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd32dc-1f0d-42a1-a1e3-353a3344a77e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:14.849147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d5ed6-2b70-4b05-8db8-58f4d5b749a2 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:14.882903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926030d-4d66-4eed-bf95-d3c877c70ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:14.883574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926030d-4d66-4eed-bf95-d3c877c70ced None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:14.883858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926030d-4d66-4eed-bf95-d3c877c70ced None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:14.884138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926030d-4d66-4eed-bf95-d3c877c70ced None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:14.884879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926030d-4d66-4eed-bf95-d3c877c70ced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:14.885194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926030d-4d66-4eed-bf95-d3c877c70ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:14.886606 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926030d-4d66-4eed-bf95-d3c877c70ced None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:14.894461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 41/78] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:14.895247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926030d-4d66-4eed-bf95-d3c877c70ced None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.943864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 38/79] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:14.944625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd32dc-1f0d-42a1-a1e3-353a3344a77e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:14.970195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.000836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926030d-4d66-4eed-bf95-d3c877c70ced None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.021932 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.034566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d759fb3-a009-401e-aedd-b87e74246225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.035446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d759fb3-a009-401e-aedd-b87e74246225 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.035730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d759fb3-a009-401e-aedd-b87e74246225 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.036007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d759fb3-a009-401e-aedd-b87e74246225 None admin] PATH_INFO: `/v3/users/d16970c992ef45ad92a1879619e5cda1` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.037704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d759fb3-a009-401e-aedd-b87e74246225 None admin] RBAC: Authorizing `identity:get_user(user_id=d16970c992ef45ad92a1879619e5cda1)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.039209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d759fb3-a009-401e-aedd-b87e74246225 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.041034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 42/80] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/users/d16970c992ef45ad92a1879619e5cda1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:15.041136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd32dc-1f0d-42a1-a1e3-353a3344a77e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.041605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d759fb3-a009-401e-aedd-b87e74246225 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.079650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeed8e-5750-4bfd-bbaf-c165edba7387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.080444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeed8e-5750-4bfd-bbaf-c165edba7387 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.080730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeed8e-5750-4bfd-bbaf-c165edba7387 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.081011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeed8e-5750-4bfd-bbaf-c165edba7387 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.091188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeed8e-5750-4bfd-bbaf-c165edba7387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-8efeed8e-5750-4bfd-bbaf-c165edba7387 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:15.099534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:15.100393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:15.101141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 39/81] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:15.101764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeed8e-5750-4bfd-bbaf-c165edba7387 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.145418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d759fb3-a009-401e-aedd-b87e74246225 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.179474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8500ed-dbf1-433a-8382-0a2f0c0b3587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.180270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8500ed-dbf1-433a-8382-0a2f0c0b3587 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.180554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8500ed-dbf1-433a-8382-0a2f0c0b3587 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.180842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8500ed-dbf1-433a-8382-0a2f0c0b3587 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.182018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8500ed-dbf1-433a-8382-0a2f0c0b3587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.183521 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8500ed-dbf1-433a-8382-0a2f0c0b3587 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.185142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 43/82] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:15.189907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8500ed-dbf1-433a-8382-0a2f0c0b3587 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.197106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.205636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeed8e-5750-4bfd-bbaf-c165edba7387 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.240686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793ba0e-3868-4ef2-b757-bbee9f05f506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.241558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793ba0e-3868-4ef2-b757-bbee9f05f506 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.241845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793ba0e-3868-4ef2-b757-bbee9f05f506 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.242119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793ba0e-3868-4ef2-b757-bbee9f05f506 None admin] PATH_INFO: `/v3/users/b03aa99594304e7f8e065f8b3ac2b405` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.243349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793ba0e-3868-4ef2-b757-bbee9f05f506 None admin] RBAC: Authorizing `identity:get_user(user_id=b03aa99594304e7f8e065f8b3ac2b405)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.244793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793ba0e-3868-4ef2-b757-bbee9f05f506 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.246434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 40/83] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/users/b03aa99594304e7f8e065f8b3ac2b405 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:15.247199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793ba0e-3868-4ef2-b757-bbee9f05f506 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.257287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.293409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8500ed-dbf1-433a-8382-0a2f0c0b3587 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.327937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34528687-da37-4481-91b2-2ea0a6e2b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.328790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34528687-da37-4481-91b2-2ea0a6e2b407 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.329074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34528687-da37-4481-91b2-2ea0a6e2b407 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.329347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34528687-da37-4481-91b2-2ea0a6e2b407 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.330555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34528687-da37-4481-91b2-2ea0a6e2b407 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.332000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34528687-da37-4481-91b2-2ea0a6e2b407 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.333746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 44/84] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:15.334561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34528687-da37-4481-91b2-2ea0a6e2b407 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.347174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793ba0e-3868-4ef2-b757-bbee9f05f506 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.381023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df150-7268-4794-9f58-8713bbcefd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.381672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df150-7268-4794-9f58-8713bbcefd6e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.381962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df150-7268-4794-9f58-8713bbcefd6e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.382245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df150-7268-4794-9f58-8713bbcefd6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.409758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.432927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34528687-da37-4481-91b2-2ea0a6e2b407 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.450891 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df150-7268-4794-9f58-8713bbcefd6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.452298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df150-7268-4794-9f58-8713bbcefd6e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.461890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.466775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c0f70-7d5c-4f67-b4cd-4467e9d94b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.467449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c0f70-7d5c-4f67-b4cd-4467e9d94b90 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.467733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c0f70-7d5c-4f67-b4cd-4467e9d94b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.468016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c0f70-7d5c-4f67-b4cd-4467e9d94b90 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.468762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c0f70-7d5c-4f67-b4cd-4467e9d94b90 None admin] RBAC: Adding query filter params (name=member) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:15.469071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c0f70-7d5c-4f67-b4cd-4467e9d94b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.470488 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c0f70-7d5c-4f67-b4cd-4467e9d94b90 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.478550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 45/85] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:15.479319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c0f70-7d5c-4f67-b4cd-4467e9d94b90 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.553500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 41/86] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:15.554341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df150-7268-4794-9f58-8713bbcefd6e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.578054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c0f70-7d5c-4f67-b4cd-4467e9d94b90 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.610281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8b560-fca5-411a-8cc0-3d67ebe81139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.610989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b560-fca5-411a-8cc0-3d67ebe81139 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.611276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b560-fca5-411a-8cc0-3d67ebe81139 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.611554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b560-fca5-411a-8cc0-3d67ebe81139 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.612270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8b560-fca5-411a-8cc0-3d67ebe81139 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.613736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8b560-fca5-411a-8cc0-3d67ebe81139 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.623007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.635422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 46/87] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:15 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:15.636218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8b560-fca5-411a-8cc0-3d67ebe81139 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.667408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df150-7268-4794-9f58-8713bbcefd6e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.680526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.710336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287260f8-74dd-44af-83e0-6e9ef968cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.711276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287260f8-74dd-44af-83e0-6e9ef968cade None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.711583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287260f8-74dd-44af-83e0-6e9ef968cade None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.711934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287260f8-74dd-44af-83e0-6e9ef968cade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.758077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8b560-fca5-411a-8cc0-3d67ebe81139 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.792141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287260f8-74dd-44af-83e0-6e9ef968cade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.793746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287260f8-74dd-44af-83e0-6e9ef968cade None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.795547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ebfef-3690-4cf0-9306-f4be10e43751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:15.796226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ebfef-3690-4cf0-9306-f4be10e43751 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:15.796508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ebfef-3690-4cf0-9306-f4be10e43751 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:15.796787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ebfef-3690-4cf0-9306-f4be10e43751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:15.797635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ebfef-3690-4cf0-9306-f4be10e43751 None admin] RBAC: Adding query filter params (role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=1f0cac840efb41429100d553f9c6d470, user.id=b03aa99594304e7f8e065f8b3ac2b405) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:15.797945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ebfef-3690-4cf0-9306-f4be10e43751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:15.799476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ebfef-3690-4cf0-9306-f4be10e43751 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:15.806546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 47/88] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/role_assignments?user.id=b03aa99594304e7f8e065f8b3ac2b405&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:15.806546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ebfef-3690-4cf0-9306-f4be10e43751 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.887551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:15.940954 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 42/89] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:15.942143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287260f8-74dd-44af-83e0-6e9ef968cade None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:15.955622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ebfef-3690-4cf0-9306-f4be10e43751 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:15.958865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:16.003727 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642dce-171f-4604-9788-4e2cb640197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:16.004546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642dce-171f-4604-9788-4e2cb640197b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:16.004837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642dce-171f-4604-9788-4e2cb640197b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:16.005687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642dce-171f-4604-9788-4e2cb640197b None admin] PATH_INFO: `/v3/users/b03aa99594304e7f8e065f8b3ac2b405` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:16.007938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1642dce-171f-4604-9788-4e2cb640197b None admin] RBAC: Authorizing `identity:get_user(user_id=b03aa99594304e7f8e065f8b3ac2b405)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:16.009500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1642dce-171f-4604-9788-4e2cb640197b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:16.011612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 48/90] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/users/b03aa99594304e7f8e065f8b3ac2b405 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:16.013024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642dce-171f-4604-9788-4e2cb640197b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:16.092830 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287260f8-74dd-44af-83e0-6e9ef968cade None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:16.145404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480f98-6ea3-4c14-8a5f-3fd679b542b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:16.145922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642dce-171f-4604-9788-4e2cb640197b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:16.146966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480f98-6ea3-4c14-8a5f-3fd679b542b1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:16.147846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480f98-6ea3-4c14-8a5f-3fd679b542b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:16.149720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480f98-6ea3-4c14-8a5f-3fd679b542b1 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:16.151701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef480f98-6ea3-4c14-8a5f-3fd679b542b1 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:16.153437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef480f98-6ea3-4c14-8a5f-3fd679b542b1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:16.155942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 43/91] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:15 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:16.157403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480f98-6ea3-4c14-8a5f-3fd679b542b1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:16.177772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:16.189549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f43ee-77ad-438b-a071-90a649973fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:16.190874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f43ee-77ad-438b-a071-90a649973fd8 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:16.191173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f43ee-77ad-438b-a071-90a649973fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:16.191454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f43ee-77ad-438b-a071-90a649973fd8 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:16.193511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f43ee-77ad-438b-a071-90a649973fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:16.195025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f43ee-77ad-438b-a071-90a649973fd8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:16.197540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 49/92] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:16 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:16.198617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f43ee-77ad-438b-a071-90a649973fd8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:16.279933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:16.317078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480f98-6ea3-4c14-8a5f-3fd679b542b1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:16.354306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282431bd-f0d4-4c60-84a2-820a40ec19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:16.354995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282431bd-f0d4-4c60-84a2-820a40ec19a4 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:16.355281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282431bd-f0d4-4c60-84a2-820a40ec19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:16.355559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282431bd-f0d4-4c60-84a2-820a40ec19a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:16.379877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f43ee-77ad-438b-a071-90a649973fd8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:16.416142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd7381-c9c2-4f4b-a1d8-b91fd3263b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:16.416810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd7381-c9c2-4f4b-a1d8-b91fd3263b81 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:16.417151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd7381-c9c2-4f4b-a1d8-b91fd3263b81 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:16.417436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd7381-c9c2-4f4b-a1d8-b91fd3263b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:16.418373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd7381-c9c2-4f4b-a1d8-b91fd3263b81 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=1f0cac840efb41429100d553f9c6d470, user.id=d16970c992ef45ad92a1879619e5cda1) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:16.418851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd7381-c9c2-4f4b-a1d8-b91fd3263b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:16.420312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd7381-c9c2-4f4b-a1d8-b91fd3263b81 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:16.426312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 50/93] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:16 2022] GET /identity/v3/role_assignments?user.id=d16970c992ef45ad92a1879619e5cda1&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:16.427732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd7381-c9c2-4f4b-a1d8-b91fd3263b81 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:16.433727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282431bd-f0d4-4c60-84a2-820a40ec19a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:16.435287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282431bd-f0d4-4c60-84a2-820a40ec19a4 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:16.509032 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:16.550615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:16.602017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 44/94] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:16.608432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282431bd-f0d4-4c60-84a2-820a40ec19a4 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:16.612236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd7381-c9c2-4f4b-a1d8-b91fd3263b81 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:16.661523 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9185f66-8438-43ba-98e3-03284f47cefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:16.662193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9185f66-8438-43ba-98e3-03284f47cefe None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:16.662511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9185f66-8438-43ba-98e3-03284f47cefe None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:16.662794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9185f66-8438-43ba-98e3-03284f47cefe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:16.663642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9185f66-8438-43ba-98e3-03284f47cefe None admin] RBAC: Adding query filter params (role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=1f0cac840efb41429100d553f9c6d470, user.id=b03aa99594304e7f8e065f8b3ac2b405) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:16.663958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9185f66-8438-43ba-98e3-03284f47cefe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:16.665446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9185f66-8438-43ba-98e3-03284f47cefe None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:16.674258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 51/95] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:16 2022] GET /identity/v3/role_assignments?user.id=b03aa99594304e7f8e065f8b3ac2b405&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:16.771351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282431bd-f0d4-4c60-84a2-820a40ec19a4 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:16.818020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003f492-2790-45fa-94cb-5ffeccbd41c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:16.818871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f492-2790-45fa-94cb-5ffeccbd41c6 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:16.819152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f492-2790-45fa-94cb-5ffeccbd41c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:16.819429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f492-2790-45fa-94cb-5ffeccbd41c6 None admin] PATH_INFO: `/v3/projects/988a379e1cfc4bf38b8071d56d086f63` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:16.820692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003f492-2790-45fa-94cb-5ffeccbd41c6 None admin] RBAC: Authorizing `identity:get_project(project_id=988a379e1cfc4bf38b8071d56d086f63)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:16.822132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003f492-2790-45fa-94cb-5ffeccbd41c6 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:16.823874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 45/96] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:16 2022] GET /identity/v3/projects/988a379e1cfc4bf38b8071d56d086f63 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:16.835570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9185f66-8438-43ba-98e3-03284f47cefe None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:16.959753 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9185f66-8438-43ba-98e3-03284f47cefe None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:16.994917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:16.996208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ab7d9-d8c7-4707-90b2-b6788cea1e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:16.997134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ab7d9-d8c7-4707-90b2-b6788cea1e78 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:16.997724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ab7d9-d8c7-4707-90b2-b6788cea1e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:16.998289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ab7d9-d8c7-4707-90b2-b6788cea1e78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:16.999432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ab7d9-d8c7-4707-90b2-b6788cea1e78 None admin] RBAC: Adding query filter params (role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=988a379e1cfc4bf38b8071d56d086f63, user.id=b03aa99594304e7f8e065f8b3ac2b405) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:16.999960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ab7d9-d8c7-4707-90b2-b6788cea1e78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:17.001626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ab7d9-d8c7-4707-90b2-b6788cea1e78 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:17.008929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 52/97] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:16 2022] GET /identity/v3/role_assignments?user.id=b03aa99594304e7f8e065f8b3ac2b405&scope.project.id=988a379e1cfc4bf38b8071d56d086f63&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:18.781400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a69b5-848d-4bb7-8928-b315a4ebad42 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.781892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a69b5-848d-4bb7-8928-b315a4ebad42 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.781892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a69b5-848d-4bb7-8928-b315a4ebad42 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.783267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 46/98] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:18.788960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb20481-4913-40a4-bb05-69e83c0e4efa None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:18.789351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb20481-4913-40a4-bb05-69e83c0e4efa None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:18.789530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb20481-4913-40a4-bb05-69e83c0e4efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:18.807101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ffb20481-4913-40a4-bb05-69e83c0e4efa None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:18.808298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ffb20481-4913-40a4-bb05-69e83c0e4efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:18.892222 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 53/99] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:18.926329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a69b5-848d-4bb7-8928-b315a4ebad42 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:18.983754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.059291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a69b5-848d-4bb7-8928-b315a4ebad42 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.097749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad7892-fa0b-48f5-827d-66f88d56066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.099147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad7892-fa0b-48f5-827d-66f88d56066c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.099436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad7892-fa0b-48f5-827d-66f88d56066c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.099844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad7892-fa0b-48f5-827d-66f88d56066c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.113687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad7892-fa0b-48f5-827d-66f88d56066c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e4ad7892-fa0b-48f5-827d-66f88d56066c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:19.123747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:19.124649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:19.126073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 47/100] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:19.131697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad7892-fa0b-48f5-827d-66f88d56066c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.132393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c684-58a8-430e-97a9-7718b0e86d08 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.132686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c684-58a8-430e-97a9-7718b0e86d08 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.132971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17c684-58a8-430e-97a9-7718b0e86d08 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.134346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 54/101] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:19.140966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb44b-a99a-477b-9385-4f2f445f25ba None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.141253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb44b-a99a-477b-9385-4f2f445f25ba None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.141532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb44b-a99a-477b-9385-4f2f445f25ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.172631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-250fb44b-a99a-477b-9385-4f2f445f25ba None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:19.173811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-250fb44b-a99a-477b-9385-4f2f445f25ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:19.265707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad7892-fa0b-48f5-827d-66f88d56066c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.269930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.302934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 55/102] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:19.307027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201d390-3f91-4fdd-8a27-ec82fcc3765f None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.307319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201d390-3f91-4fdd-8a27-ec82fcc3765f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.307600 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201d390-3f91-4fdd-8a27-ec82fcc3765f None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.309157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 56/103] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:19.316513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446585a-aee6-43b5-8806-ddae5facc601 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.316725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446585a-aee6-43b5-8806-ddae5facc601 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.317040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446585a-aee6-43b5-8806-ddae5facc601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.335629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285301cb-a67a-44bb-95ba-015808fd99e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.336322 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285301cb-a67a-44bb-95ba-015808fd99e1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.336608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285301cb-a67a-44bb-95ba-015808fd99e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.336888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285301cb-a67a-44bb-95ba-015808fd99e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.337644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285301cb-a67a-44bb-95ba-015808fd99e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:19.338164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285301cb-a67a-44bb-95ba-015808fd99e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:19.341231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285301cb-a67a-44bb-95ba-015808fd99e1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:19.348842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-1446585a-aee6-43b5-8806-ddae5facc601 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:19.350041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1446585a-aee6-43b5-8806-ddae5facc601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:19.357125 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 48/104] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:19.358043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285301cb-a67a-44bb-95ba-015808fd99e1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.458112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.486049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 57/105] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:19.487324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446585a-aee6-43b5-8806-ddae5facc601 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.538351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285301cb-a67a-44bb-95ba-015808fd99e1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.583601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b94b13-3aae-4688-b1c9-14bba3621459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.584481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b94b13-3aae-4688-b1c9-14bba3621459 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.584772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b94b13-3aae-4688-b1c9-14bba3621459 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.585047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b94b13-3aae-4688-b1c9-14bba3621459 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.597257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b94b13-3aae-4688-b1c9-14bba3621459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-81b94b13-3aae-4688-b1c9-14bba3621459 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:19.606083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:19.606992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:19.607739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 49/106] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:19.608865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c6dd6-6691-4b26-9cd4-222a8eb577f6 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.608865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c6dd6-6691-4b26-9cd4-222a8eb577f6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.609115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c6dd6-6691-4b26-9cd4-222a8eb577f6 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.615766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 50/107] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:19.620270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c6dd6-6691-4b26-9cd4-222a8eb577f6 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.624637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446585a-aee6-43b5-8806-ddae5facc601 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.656050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.661646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356ebfc-1a24-4f8f-b567-d4f1503f588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.662719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356ebfc-1a24-4f8f-b567-d4f1503f588e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.662941 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356ebfc-1a24-4f8f-b567-d4f1503f588e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.663224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356ebfc-1a24-4f8f-b567-d4f1503f588e None admin] PATH_INFO: `/v3/users/b03aa99594304e7f8e065f8b3ac2b405` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.664527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356ebfc-1a24-4f8f-b567-d4f1503f588e None admin] RBAC: Authorizing `identity:get_user(user_id=b03aa99594304e7f8e065f8b3ac2b405)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:19.666062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356ebfc-1a24-4f8f-b567-d4f1503f588e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:19.667974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 58/108] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/users/b03aa99594304e7f8e065f8b3ac2b405 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:19.673085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356ebfc-1a24-4f8f-b567-d4f1503f588e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.734749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.758784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c6dd6-6691-4b26-9cd4-222a8eb577f6 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.790413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356ebfc-1a24-4f8f-b567-d4f1503f588e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.796204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a1fff-3558-487c-9e30-3615a7fcfee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.797135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a1fff-3558-487c-9e30-3615a7fcfee8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.797521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a1fff-3558-487c-9e30-3615a7fcfee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.797896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a1fff-3558-487c-9e30-3615a7fcfee8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.799215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a1fff-3558-487c-9e30-3615a7fcfee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:19.800882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a1fff-3558-487c-9e30-3615a7fcfee8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:19.802823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 51/109] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:19.807724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a1b85-d62d-4449-b793-bf88befd4db5 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.808530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a1b85-d62d-4449-b793-bf88befd4db5 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.808530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a1b85-d62d-4449-b793-bf88befd4db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.827692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-031a1b85-d62d-4449-b793-bf88befd4db5 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:19.829044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-031a1b85-d62d-4449-b793-bf88befd4db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:19.833974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7649-b873-4a9e-9f48-288d9a854ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:19.834884 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7649-b873-4a9e-9f48-288d9a854ca2 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:19.835312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7649-b873-4a9e-9f48-288d9a854ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:19.835726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7649-b873-4a9e-9f48-288d9a854ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:19.836616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7649-b873-4a9e-9f48-288d9a854ca2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:19.837063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7649-b873-4a9e-9f48-288d9a854ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:19.839087 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7649-b873-4a9e-9f48-288d9a854ca2 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:19.850393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 59/110] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:19.851399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7649-b873-4a9e-9f48-288d9a854ca2 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.912809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 52/111] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:19.918486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a1b85-d62d-4449-b793-bf88befd4db5 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:19.959823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:19.988569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7649-b873-4a9e-9f48-288d9a854ca2 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:19.997221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:20.026883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8528a-1a9f-4144-b5ca-7ae9b78b6822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.027747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8528a-1a9f-4144-b5ca-7ae9b78b6822 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.028036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8528a-1a9f-4144-b5ca-7ae9b78b6822 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.028313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8528a-1a9f-4144-b5ca-7ae9b78b6822 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.029503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8528a-1a9f-4144-b5ca-7ae9b78b6822 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.031012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8528a-1a9f-4144-b5ca-7ae9b78b6822 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.032858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 60/112] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:19 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:20.035574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8528a-1a9f-4144-b5ca-7ae9b78b6822 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.039244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a1b85-d62d-4449-b793-bf88befd4db5 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.080290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c18b2e-16e2-41e7-a847-92bf07bef5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.081227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c18b2e-16e2-41e7-a847-92bf07bef5a6 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.081654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c18b2e-16e2-41e7-a847-92bf07bef5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.082070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c18b2e-16e2-41e7-a847-92bf07bef5a6 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.083017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c18b2e-16e2-41e7-a847-92bf07bef5a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.085433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c18b2e-16e2-41e7-a847-92bf07bef5a6 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.116153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 53/113] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:36:19 2022] POST /identity/v3/projects => generated 302 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:20.123481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c18b2e-16e2-41e7-a847-92bf07bef5a6 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.156107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8528a-1a9f-4144-b5ca-7ae9b78b6822 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.203500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b12376-21a3-4110-a9b1-4569bfa18ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.204401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b12376-21a3-4110-a9b1-4569bfa18ea4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.204689 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b12376-21a3-4110-a9b1-4569bfa18ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.204970 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b12376-21a3-4110-a9b1-4569bfa18ea4 None admin] PATH_INFO: `/v3/users/7087e1a0862144a7ab1e3082aa5b1c32` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.216934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:20.221414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b12376-21a3-4110-a9b1-4569bfa18ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=7087e1a0862144a7ab1e3082aa5b1c32)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.223286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b12376-21a3-4110-a9b1-4569bfa18ea4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.225254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 61/114] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:20 2022] GET /identity/v3/users/7087e1a0862144a7ab1e3082aa5b1c32 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:20.226779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a607b6-71e2-4da7-a1a5-27b9ee416f9e None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.227063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a607b6-71e2-4da7-a1a5-27b9ee416f9e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.227342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a607b6-71e2-4da7-a1a5-27b9ee416f9e None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.228823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 62/115] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:20.229319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a607b6-71e2-4da7-a1a5-27b9ee416f9e None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.253706 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c18b2e-16e2-41e7-a847-92bf07bef5a6 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.267737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:20.293638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941b45-f202-4e71-92c0-31fa01c8605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.295260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941b45-f202-4e71-92c0-31fa01c8605f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.295858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941b45-f202-4e71-92c0-31fa01c8605f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.296171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941b45-f202-4e71-92c0-31fa01c8605f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.311590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56941b45-f202-4e71-92c0-31fa01c8605f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-56941b45-f202-4e71-92c0-31fa01c8605f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:20.320338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:20.321195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:20.321949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 54/116] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:20.323082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6973e-3188-4005-a11b-1147fe45d55a None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.323082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6973e-3188-4005-a11b-1147fe45d55a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.323380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6973e-3188-4005-a11b-1147fe45d55a None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.324775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 55/117] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:20.325762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6973e-3188-4005-a11b-1147fe45d55a None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.350316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a607b6-71e2-4da7-a1a5-27b9ee416f9e None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.387260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a80b09-93f2-4e34-a859-74f0349eaa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.388151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80b09-93f2-4e34-a859-74f0349eaa3f None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.388438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80b09-93f2-4e34-a859-74f0349eaa3f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.388761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80b09-93f2-4e34-a859-74f0349eaa3f None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470/users/b03aa99594304e7f8e065f8b3ac2b405/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.390721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a80b09-93f2-4e34-a859-74f0349eaa3f None admin] RBAC: Authorizing `identity:create_grant(project_id=1f0cac840efb41429100d553f9c6d470, user_id=b03aa99594304e7f8e065f8b3ac2b405, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.392169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a80b09-93f2-4e34-a859-74f0349eaa3f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.406948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 63/118] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:20 2022] PUT /identity/v3/projects/1f0cac840efb41429100d553f9c6d470/users/b03aa99594304e7f8e065f8b3ac2b405/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:20.408612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9cde-5a70-4954-9719-749c46e9da70 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.409386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9cde-5a70-4954-9719-749c46e9da70 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.409386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9cde-5a70-4954-9719-749c46e9da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.430691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c06e9cde-5a70-4954-9719-749c46e9da70 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:20.432490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c06e9cde-5a70-4954-9719-749c46e9da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:20.448331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6973e-3188-4005-a11b-1147fe45d55a None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.490269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521b848-5daa-42d5-b603-d11276e7cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.491197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b848-5daa-42d5-b603-d11276e7cf66 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.491595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b848-5daa-42d5-b603-d11276e7cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.491944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b848-5daa-42d5-b603-d11276e7cf66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.513955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:20.522830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 64/119] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:20.527640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9cde-5a70-4954-9719-749c46e9da70 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.574570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:20.591917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521b848-5daa-42d5-b603-d11276e7cf66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.593495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521b848-5daa-42d5-b603-d11276e7cf66 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.669723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9cde-5a70-4954-9719-749c46e9da70 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.704587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57845bf7-0f28-427e-879f-04836e4af1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.705254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57845bf7-0f28-427e-879f-04836e4af1e7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.705580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57845bf7-0f28-427e-879f-04836e4af1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.705754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 56/120] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:20.705848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57845bf7-0f28-427e-879f-04836e4af1e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.706597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57845bf7-0f28-427e-879f-04836e4af1e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:20.706909 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57845bf7-0f28-427e-879f-04836e4af1e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:20.708418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83925a91-2acd-444a-b3cb-a03b7f9fe5db None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.708910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83925a91-2acd-444a-b3cb-a03b7f9fe5db None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.709015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57845bf7-0f28-427e-879f-04836e4af1e7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:20.709633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83925a91-2acd-444a-b3cb-a03b7f9fe5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.718242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 65/121] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:20.719107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57845bf7-0f28-427e-879f-04836e4af1e7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.730982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-83925a91-2acd-444a-b3cb-a03b7f9fe5db None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:20.732800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-83925a91-2acd-444a-b3cb-a03b7f9fe5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:20.818403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 57/122] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:20.818403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83925a91-2acd-444a-b3cb-a03b7f9fe5db None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.819050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:20.827315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:20.854968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57845bf7-0f28-427e-879f-04836e4af1e7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:20.890535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf4c6c-2d18-44dd-9184-ce9804178257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:20.891400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4c6c-2d18-44dd-9184-ce9804178257 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:20.891626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4c6c-2d18-44dd-9184-ce9804178257 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:20.891905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4c6c-2d18-44dd-9184-ce9804178257 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:20.904110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf4c6c-2d18-44dd-9184-ce9804178257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-68bf4c6c-2d18-44dd-9184-ce9804178257 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:20.911416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:20.912245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 66/123] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:20.913513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf4c6c-2d18-44dd-9184-ce9804178257 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:20.961891 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83925a91-2acd-444a-b3cb-a03b7f9fe5db None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:21.009414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99768d-8b53-403a-90f4-5c697e2d2ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:21.010734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99768d-8b53-403a-90f4-5c697e2d2ef8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:21.011043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99768d-8b53-403a-90f4-5c697e2d2ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:21.011331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99768d-8b53-403a-90f4-5c697e2d2ef8 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:21.012730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99768d-8b53-403a-90f4-5c697e2d2ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:21.014689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99768d-8b53-403a-90f4-5c697e2d2ef8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:21.016860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 58/124] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:20 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:21.017953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99768d-8b53-403a-90f4-5c697e2d2ef8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:21.023991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf4c6c-2d18-44dd-9184-ce9804178257 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:21.061430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:21.065666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf6276-7d1e-41bc-9cb5-1760de41061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:21.066590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6276-7d1e-41bc-9cb5-1760de41061c None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:21.067406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6276-7d1e-41bc-9cb5-1760de41061c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:21.067747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6276-7d1e-41bc-9cb5-1760de41061c None admin] PATH_INFO: `/v3/users/d16970c992ef45ad92a1879619e5cda1` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:21.069040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf6276-7d1e-41bc-9cb5-1760de41061c None admin] RBAC: Authorizing `identity:get_user(user_id=d16970c992ef45ad92a1879619e5cda1)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:21.071154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf6276-7d1e-41bc-9cb5-1760de41061c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:21.073721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 67/125] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:20 2022] GET /identity/v3/users/d16970c992ef45ad92a1879619e5cda1 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:21.074531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf6276-7d1e-41bc-9cb5-1760de41061c None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:21.098630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:21.142019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99768d-8b53-403a-90f4-5c697e2d2ef8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:21.182661 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa13cf5-847c-4a32-9e0d-441286a426fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:21.183483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa13cf5-847c-4a32-9e0d-441286a426fc None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:21.183770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa13cf5-847c-4a32-9e0d-441286a426fc None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:21.184151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa13cf5-847c-4a32-9e0d-441286a426fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:21.196112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa13cf5-847c-4a32-9e0d-441286a426fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-5fa13cf5-847c-4a32-9e0d-441286a426fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:21.204865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:21.205720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 59/126] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:21.208055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa13cf5-847c-4a32-9e0d-441286a426fc None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:21.213530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf6276-7d1e-41bc-9cb5-1760de41061c None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:21.259770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd644b2-4638-4e85-aa19-2b07f8679bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:21.260851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd644b2-4638-4e85-aa19-2b07f8679bde None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:21.261239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd644b2-4638-4e85-aa19-2b07f8679bde None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:21.262016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd644b2-4638-4e85-aa19-2b07f8679bde None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:21.263150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd644b2-4638-4e85-aa19-2b07f8679bde None admin] RBAC: Adding query filter params (name=member) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:21.263539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd644b2-4638-4e85-aa19-2b07f8679bde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:21.265642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd644b2-4638-4e85-aa19-2b07f8679bde None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:21.276817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 68/127] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:21.278297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd644b2-4638-4e85-aa19-2b07f8679bde None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:21.314690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:21.323841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa13cf5-847c-4a32-9e0d-441286a426fc None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:21.363401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbb9c8-0f57-48df-b1de-ad6e8d510e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:21.364798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbb9c8-0f57-48df-b1de-ad6e8d510e33 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:21.365182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbb9c8-0f57-48df-b1de-ad6e8d510e33 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:21.365673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbb9c8-0f57-48df-b1de-ad6e8d510e33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:21.366745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbb9c8-0f57-48df-b1de-ad6e8d510e33 None admin] RBAC: Adding query filter params (role.id=35aed85335ec44d7b4e694c59769a360, scope.project.id=1f0cac840efb41429100d553f9c6d470, user.id=7087e1a0862144a7ab1e3082aa5b1c32) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:21.367164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbb9c8-0f57-48df-b1de-ad6e8d510e33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:21.368768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbb9c8-0f57-48df-b1de-ad6e8d510e33 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:21.377317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:21.379874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 60/128] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:21 2022] GET /identity/v3/role_assignments?user.id=7087e1a0862144a7ab1e3082aa5b1c32&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=35aed85335ec44d7b4e694c59769a360 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:21.380704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbb9c8-0f57-48df-b1de-ad6e8d510e33 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:21.411174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd644b2-4638-4e85-aa19-2b07f8679bde None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:21.456866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407165e-b51d-4f52-888b-fb76e0bd9215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:21.459932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407165e-b51d-4f52-888b-fb76e0bd9215 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:21.464633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407165e-b51d-4f52-888b-fb76e0bd9215 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:21.465225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407165e-b51d-4f52-888b-fb76e0bd9215 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:21.466987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407165e-b51d-4f52-888b-fb76e0bd9215 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:21.468763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407165e-b51d-4f52-888b-fb76e0bd9215 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:21.476220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 69/129] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:21 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:21.477383 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407165e-b51d-4f52-888b-fb76e0bd9215 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:21.570288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbb9c8-0f57-48df-b1de-ad6e8d510e33 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:21.634325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e8301-b00c-4830-ace6-4ab6fa6eb9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:21.635177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e8301-b00c-4830-ace6-4ab6fa6eb9ba None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:21.635465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e8301-b00c-4830-ace6-4ab6fa6eb9ba None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:21.635749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e8301-b00c-4830-ace6-4ab6fa6eb9ba None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:21.636657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e8301-b00c-4830-ace6-4ab6fa6eb9ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:21.636978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e8301-b00c-4830-ace6-4ab6fa6eb9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:21.638350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e8301-b00c-4830-ace6-4ab6fa6eb9ba None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:21.648778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 61/130] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:21.649586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e8301-b00c-4830-ace6-4ab6fa6eb9ba None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:21.676457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:21.691363 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407165e-b51d-4f52-888b-fb76e0bd9215 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:21.754091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8795670-2786-49c8-b919-433280c44d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:21.755180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8795670-2786-49c8-b919-433280c44d94 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:21.755467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8795670-2786-49c8-b919-433280c44d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:21.755744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8795670-2786-49c8-b919-433280c44d94 None admin] PATH_INFO: `/v3/users/b03aa99594304e7f8e065f8b3ac2b405` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:21.759306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8795670-2786-49c8-b919-433280c44d94 None admin] RBAC: Authorizing `identity:get_user(user_id=b03aa99594304e7f8e065f8b3ac2b405)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:21.761029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8795670-2786-49c8-b919-433280c44d94 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:21.762938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 70/131] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:21 2022] GET /identity/v3/users/b03aa99594304e7f8e065f8b3ac2b405 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:21.763801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e8301-b00c-4830-ace6-4ab6fa6eb9ba None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:21.764437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8795670-2786-49c8-b919-433280c44d94 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:21.796184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:21.803619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988259-81e9-46ca-a947-4f28e7ec8ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:21.804789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988259-81e9-46ca-a947-4f28e7ec8ca0 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:21.805079 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988259-81e9-46ca-a947-4f28e7ec8ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:21.805360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988259-81e9-46ca-a947-4f28e7ec8ca0 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470/users/d16970c992ef45ad92a1879619e5cda1/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:21.808009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23988259-81e9-46ca-a947-4f28e7ec8ca0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f0cac840efb41429100d553f9c6d470, user_id=d16970c992ef45ad92a1879619e5cda1, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:21.809564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23988259-81e9-46ca-a947-4f28e7ec8ca0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:21.826744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 62/132] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:21 2022] PUT /identity/v3/projects/1f0cac840efb41429100d553f9c6d470/users/d16970c992ef45ad92a1879619e5cda1/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:21.827599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988259-81e9-46ca-a947-4f28e7ec8ca0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:21.958797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:21.974143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988259-81e9-46ca-a947-4f28e7ec8ca0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.015379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482dbd2-c313-4914-82d1-edb6eb952a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.016100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8795670-2786-49c8-b919-433280c44d94 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.016533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482dbd2-c313-4914-82d1-edb6eb952a0c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.016533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482dbd2-c313-4914-82d1-edb6eb952a0c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.016690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482dbd2-c313-4914-82d1-edb6eb952a0c None admin] PATH_INFO: `/v3/projects/988a379e1cfc4bf38b8071d56d086f63` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.017882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482dbd2-c313-4914-82d1-edb6eb952a0c None admin] RBAC: Authorizing `identity:get_project(project_id=988a379e1cfc4bf38b8071d56d086f63)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.022423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482dbd2-c313-4914-82d1-edb6eb952a0c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.022423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 63/133] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:21 2022] GET /identity/v3/projects/988a379e1cfc4bf38b8071d56d086f63 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:22.028073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482dbd2-c313-4914-82d1-edb6eb952a0c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.105051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f65418-5ca2-4530-b6cc-d13ee3020fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.106427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f65418-5ca2-4530-b6cc-d13ee3020fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.106965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f65418-5ca2-4530-b6cc-d13ee3020fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.107438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f65418-5ca2-4530-b6cc-d13ee3020fd0 None admin] PATH_INFO: `/v3/users/b03aa99594304e7f8e065f8b3ac2b405` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.109082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f65418-5ca2-4530-b6cc-d13ee3020fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=b03aa99594304e7f8e065f8b3ac2b405)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.119550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f65418-5ca2-4530-b6cc-d13ee3020fd0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.121704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 71/134] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:21 2022] GET /identity/v3/users/b03aa99594304e7f8e065f8b3ac2b405 => generated 275 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:22.127360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f65418-5ca2-4530-b6cc-d13ee3020fd0 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.143441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482dbd2-c313-4914-82d1-edb6eb952a0c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.187450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a542dd-9145-4991-ac31-8cacaaedc7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.188759 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a542dd-9145-4991-ac31-8cacaaedc7a7 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.189061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a542dd-9145-4991-ac31-8cacaaedc7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.189342 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a542dd-9145-4991-ac31-8cacaaedc7a7 None admin] PATH_INFO: `/v3/projects/988a379e1cfc4bf38b8071d56d086f63/users/b03aa99594304e7f8e065f8b3ac2b405/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.191707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a542dd-9145-4991-ac31-8cacaaedc7a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=988a379e1cfc4bf38b8071d56d086f63, user_id=b03aa99594304e7f8e065f8b3ac2b405, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.193415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a542dd-9145-4991-ac31-8cacaaedc7a7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.214436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 64/135] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:22 2022] PUT /identity/v3/projects/988a379e1cfc4bf38b8071d56d086f63/users/b03aa99594304e7f8e065f8b3ac2b405/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:22.272778 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:22.300738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f65418-5ca2-4530-b6cc-d13ee3020fd0 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.350402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f761d-9f22-4461-81f4-d36d7981cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.351438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f761d-9f22-4461-81f4-d36d7981cee3 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.351822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f761d-9f22-4461-81f4-d36d7981cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.352198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f761d-9f22-4461-81f4-d36d7981cee3 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.353540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f761d-9f22-4461-81f4-d36d7981cee3 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.355148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f761d-9f22-4461-81f4-d36d7981cee3 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.357024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 72/136] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:22 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:22.365214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a542dd-9145-4991-ac31-8cacaaedc7a7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.381904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:22.506783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a542dd-9145-4991-ac31-8cacaaedc7a7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.544164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d7a9d-3f95-4447-8cdf-4c3bc1960747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.545308 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d7a9d-3f95-4447-8cdf-4c3bc1960747 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.545762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d7a9d-3f95-4447-8cdf-4c3bc1960747 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.545878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7189f-b095-4567-94e4-da74d8e963d5 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.546165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7189f-b095-4567-94e4-da74d8e963d5 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.546472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7189f-b095-4567-94e4-da74d8e963d5 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.546617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d7a9d-3f95-4447-8cdf-4c3bc1960747 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470/users/b03aa99594304e7f8e065f8b3ac2b405/roles/85059d55a9ee403aa18b9580d26ccbed` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.548300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 73/137] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:22.555453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d7a9d-3f95-4447-8cdf-4c3bc1960747 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f0cac840efb41429100d553f9c6d470, user_id=b03aa99594304e7f8e065f8b3ac2b405, role_id=85059d55a9ee403aa18b9580d26ccbed)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.555842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1a1a0-683a-436b-b3c7-12d068b93c7a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.556130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1a1a0-683a-436b-b3c7-12d068b93c7a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.556409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1a1a0-683a-436b-b3c7-12d068b93c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.557801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d7a9d-3f95-4447-8cdf-4c3bc1960747 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.583235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 65/138] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:22 2022] PUT /identity/v3/projects/1f0cac840efb41429100d553f9c6d470/users/b03aa99594304e7f8e065f8b3ac2b405/roles/85059d55a9ee403aa18b9580d26ccbed => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:22.594641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-74d1a1a0-683a-436b-b3c7-12d068b93c7a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:22.595863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-74d1a1a0-683a-436b-b3c7-12d068b93c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:22.698250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 74/139] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:22.738149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d7a9d-3f95-4447-8cdf-4c3bc1960747 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:22.821376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:22.859579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d7a9d-3f95-4447-8cdf-4c3bc1960747 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:22.895831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04787665-4c67-43c5-b417-eb9b72e342a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:22.897013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04787665-4c67-43c5-b417-eb9b72e342a8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:22.897519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04787665-4c67-43c5-b417-eb9b72e342a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:22.897991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04787665-4c67-43c5-b417-eb9b72e342a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:22.899419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04787665-4c67-43c5-b417-eb9b72e342a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:22.901078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04787665-4c67-43c5-b417-eb9b72e342a8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:22.903197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 66/140] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:22.908858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1a1a0-683a-436b-b3c7-12d068b93c7a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:23.027249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:23.062161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1a1a0-683a-436b-b3c7-12d068b93c7a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:23.110517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2690-04f3-4156-b72d-fd9b251cf31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:23.111127 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2690-04f3-4156-b72d-fd9b251cf31c None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:23.111414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2690-04f3-4156-b72d-fd9b251cf31c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:23.111695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2690-04f3-4156-b72d-fd9b251cf31c None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:23.112429 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2690-04f3-4156-b72d-fd9b251cf31c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:23.113939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2690-04f3-4156-b72d-fd9b251cf31c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:23.146449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 75/141] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:22 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:23.268218 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb5d17-aa06-410a-82ea-7a377ed7c0d5 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:23.268918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb5d17-aa06-410a-82ea-7a377ed7c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:23.269425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb5d17-aa06-410a-82ea-7a377ed7c0d5 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:23.271328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 67/142] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:23.276610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e933c2-3853-48e1-8cad-2c65f0af28ab None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:23.276927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e933c2-3853-48e1-8cad-2c65f0af28ab None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:23.277182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e933c2-3853-48e1-8cad-2c65f0af28ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:23.299458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-81e933c2-3853-48e1-8cad-2c65f0af28ab None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:23.301289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-81e933c2-3853-48e1-8cad-2c65f0af28ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:23.384380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 76/143] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:23.419146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb5d17-aa06-410a-82ea-7a377ed7c0d5 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:23.548112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb5d17-aa06-410a-82ea-7a377ed7c0d5 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:23.593961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a49a9-2395-4bbb-93e2-36fcc3508180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:23.594791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a49a9-2395-4bbb-93e2-36fcc3508180 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:23.595077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a49a9-2395-4bbb-93e2-36fcc3508180 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:23.595354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a49a9-2395-4bbb-93e2-36fcc3508180 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:23.598801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:23.611712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a49a9-2395-4bbb-93e2-36fcc3508180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-872a49a9-2395-4bbb-93e2-36fcc3508180 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:23.620152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:23.621055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:23.621841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 68/144] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:23.627211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e933c2-3853-48e1-8cad-2c65f0af28ab None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:23.737620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:23.791219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e933c2-3853-48e1-8cad-2c65f0af28ab None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:23.840277 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0757d5-9476-49fb-969c-74bafa1c1f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:23.841016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0757d5-9476-49fb-969c-74bafa1c1f79 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:23.841308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0757d5-9476-49fb-969c-74bafa1c1f79 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:23.841588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0757d5-9476-49fb-969c-74bafa1c1f79 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:23.842359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0757d5-9476-49fb-969c-74bafa1c1f79 None admin] RBAC: Adding query filter params (name=member) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:23.842744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0757d5-9476-49fb-969c-74bafa1c1f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:23.844152 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0757d5-9476-49fb-969c-74bafa1c1f79 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:23.858540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 77/145] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:23.863844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a49a9-2395-4bbb-93e2-36fcc3508180 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:24.006490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a49a9-2395-4bbb-93e2-36fcc3508180 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:24.049985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33510-4aaa-4f45-b944-b3013b362a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:24.050956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33510-4aaa-4f45-b944-b3013b362a79 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:24.051240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33510-4aaa-4f45-b944-b3013b362a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:24.051514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33510-4aaa-4f45-b944-b3013b362a79 None admin] PATH_INFO: `/v3/users/b03aa99594304e7f8e065f8b3ac2b405` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:24.052748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa33510-4aaa-4f45-b944-b3013b362a79 None admin] RBAC: Authorizing `identity:get_user(user_id=b03aa99594304e7f8e065f8b3ac2b405)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:24.054192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa33510-4aaa-4f45-b944-b3013b362a79 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:24.056137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 69/146] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:23 2022] GET /identity/v3/users/b03aa99594304e7f8e065f8b3ac2b405 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:24.062349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0757d5-9476-49fb-969c-74bafa1c1f79 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:24.190959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0757d5-9476-49fb-969c-74bafa1c1f79 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:24.223303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:24.236299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d137b5-de4f-4e0b-9171-98d366c525cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:24.236958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d137b5-de4f-4e0b-9171-98d366c525cd None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:24.237252 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d137b5-de4f-4e0b-9171-98d366c525cd None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:24.237529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d137b5-de4f-4e0b-9171-98d366c525cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:24.317208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d137b5-de4f-4e0b-9171-98d366c525cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:24.318671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d137b5-de4f-4e0b-9171-98d366c525cd None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:24.426595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 78/147] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:24.431507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33510-4aaa-4f45-b944-b3013b362a79 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:24.541528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:24.598303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33510-4aaa-4f45-b944-b3013b362a79 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:24.635576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6c17d-4c54-464c-bb52-1fe9aadc3ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:24.636456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6c17d-4c54-464c-bb52-1fe9aadc3ded None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:24.636739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6c17d-4c54-464c-bb52-1fe9aadc3ded None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:24.637014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6c17d-4c54-464c-bb52-1fe9aadc3ded None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:24.638207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6c17d-4c54-464c-bb52-1fe9aadc3ded None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:24.639685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6c17d-4c54-464c-bb52-1fe9aadc3ded None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:24.641373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 70/148] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:24 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:24.648111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d137b5-de4f-4e0b-9171-98d366c525cd None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:24.694680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:24.788454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99b30b-d3ca-4cdb-b1a3-ba00c80466b8 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:24.788766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99b30b-d3ca-4cdb-b1a3-ba00c80466b8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:24.789014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99b30b-d3ca-4cdb-b1a3-ba00c80466b8 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:24.791727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 71/149] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:24.796683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e9b79-45cb-409f-b1c1-37fdaccae094 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:24.796976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e9b79-45cb-409f-b1c1-37fdaccae094 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:24.797256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e9b79-45cb-409f-b1c1-37fdaccae094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:24.801632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d137b5-de4f-4e0b-9171-98d366c525cd None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:24.824102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-226e9b79-45cb-409f-b1c1-37fdaccae094 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:24.825302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-226e9b79-45cb-409f-b1c1-37fdaccae094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:24.865785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a735aeb-0515-4910-bc7b-574a174ab6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:24.866453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735aeb-0515-4910-bc7b-574a174ab6f5 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:24.866742 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735aeb-0515-4910-bc7b-574a174ab6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:24.867021 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735aeb-0515-4910-bc7b-574a174ab6f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:24.867912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735aeb-0515-4910-bc7b-574a174ab6f5 None admin] RBAC: Adding query filter params (role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=1f0cac840efb41429100d553f9c6d470, user.id=b03aa99594304e7f8e065f8b3ac2b405) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:24.868274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735aeb-0515-4910-bc7b-574a174ab6f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:24.869850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735aeb-0515-4910-bc7b-574a174ab6f5 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:24.882052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 79/150] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:24 2022] GET /identity/v3/role_assignments?user.id=b03aa99594304e7f8e065f8b3ac2b405&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:24.938136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 72/151] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:24.974492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a735aeb-0515-4910-bc7b-574a174ab6f5 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:25.116757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:25.132271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a735aeb-0515-4910-bc7b-574a174ab6f5 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:25.179973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ea4ad-0543-4911-aa89-e47d5a155c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:25.181166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea4ad-0543-4911-aa89-e47d5a155c3e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.181647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea4ad-0543-4911-aa89-e47d5a155c3e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.182133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea4ad-0543-4911-aa89-e47d5a155c3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.198491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ea4ad-0543-4911-aa89-e47d5a155c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-2f8ea4ad-0543-4911-aa89-e47d5a155c3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:25.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:25.207661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:25.208415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:25.210931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 80/152] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:25.219562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e9b79-45cb-409f-b1c1-37fdaccae094 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:25.324535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:25.370422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e9b79-45cb-409f-b1c1-37fdaccae094 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:25.420129 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17ff53-0f99-435d-bfd9-876350004294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:25.420895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ff53-0f99-435d-bfd9-876350004294 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.421212 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ff53-0f99-435d-bfd9-876350004294 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.421533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ff53-0f99-435d-bfd9-876350004294 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.422356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17ff53-0f99-435d-bfd9-876350004294 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:25.422730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17ff53-0f99-435d-bfd9-876350004294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:25.424203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17ff53-0f99-435d-bfd9-876350004294 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:25.438739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 73/153] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:25.444611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ea4ad-0543-4911-aa89-e47d5a155c3e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:25.603694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ea4ad-0543-4911-aa89-e47d5a155c3e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:25.652521 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806d4ea-199b-498e-9bcf-94b68f3dc64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:25.653330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806d4ea-199b-498e-9bcf-94b68f3dc64e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.653614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806d4ea-199b-498e-9bcf-94b68f3dc64e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.653902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806d4ea-199b-498e-9bcf-94b68f3dc64e None admin] PATH_INFO: `/v3/users/7087e1a0862144a7ab1e3082aa5b1c32` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.655165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806d4ea-199b-498e-9bcf-94b68f3dc64e None admin] RBAC: Authorizing `identity:get_user(user_id=7087e1a0862144a7ab1e3082aa5b1c32)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:25.656630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806d4ea-199b-498e-9bcf-94b68f3dc64e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:25.658250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 81/154] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:25 2022] GET /identity/v3/users/7087e1a0862144a7ab1e3082aa5b1c32 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:25.664578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17ff53-0f99-435d-bfd9-876350004294 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:25.750287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4ddfa-e0f3-45cc-9ae7-2a3618db0bb0 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.751004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4ddfa-e0f3-45cc-9ae7-2a3618db0bb0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.751287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4ddfa-e0f3-45cc-9ae7-2a3618db0bb0 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.754561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 82/155] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:25.762532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f7461-4fdb-4053-83c9-a3f9642a3737 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.762841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f7461-4fdb-4053-83c9-a3f9642a3737 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.763119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f7461-4fdb-4053-83c9-a3f9642a3737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.793891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ba8f7461-4fdb-4053-83c9-a3f9642a3737 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:25.795128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ba8f7461-4fdb-4053-83c9-a3f9642a3737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:25.822237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:25.887970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17ff53-0f99-435d-bfd9-876350004294 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:25.924184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 83/156] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:25.947402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:25.971637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5b6e7-4b3b-4a8b-ba84-21a642431571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:25.973080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5b6e7-4b3b-4a8b-ba84-21a642431571 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:25.973362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5b6e7-4b3b-4a8b-ba84-21a642431571 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:25.973630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5b6e7-4b3b-4a8b-ba84-21a642431571 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:25.979106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5b6e7-4b3b-4a8b-ba84-21a642431571 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:25.980566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5b6e7-4b3b-4a8b-ba84-21a642431571 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:25.981168 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f7461-4fdb-4053-83c9-a3f9642a3737 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:25.982299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 74/157] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:25 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:26.003728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5b6e7-4b3b-4a8b-ba84-21a642431571 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:26.225607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5b6e7-4b3b-4a8b-ba84-21a642431571 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:26.267954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f7461-4fdb-4053-83c9-a3f9642a3737 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:26.286782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f23e53-cd24-461e-85cb-dcae5ffa9d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:26.287694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f23e53-cd24-461e-85cb-dcae5ffa9d92 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:26.287973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f23e53-cd24-461e-85cb-dcae5ffa9d92 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:26.288243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f23e53-cd24-461e-85cb-dcae5ffa9d92 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470/users/7087e1a0862144a7ab1e3082aa5b1c32/roles/35aed85335ec44d7b4e694c59769a360` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:26.290953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f23e53-cd24-461e-85cb-dcae5ffa9d92 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f0cac840efb41429100d553f9c6d470, user_id=7087e1a0862144a7ab1e3082aa5b1c32, role_id=35aed85335ec44d7b4e694c59769a360)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:26.292409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f23e53-cd24-461e-85cb-dcae5ffa9d92 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:26.324384 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 75/158] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:26 2022] PUT /identity/v3/projects/1f0cac840efb41429100d553f9c6d470/users/7087e1a0862144a7ab1e3082aa5b1c32/roles/35aed85335ec44d7b4e694c59769a360 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:36:26.325778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d65859-73f3-4325-ad64-e6e44244a983 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:26.326065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d65859-73f3-4325-ad64-e6e44244a983 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:26.326342 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d65859-73f3-4325-ad64-e6e44244a983 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:26.333474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 76/159] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:26.337224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480d422-56d0-48aa-89e6-0a39f18988ec None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:26.337541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480d422-56d0-48aa-89e6-0a39f18988ec None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:26.337794 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480d422-56d0-48aa-89e6-0a39f18988ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:26.344247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef855c-c255-45b7-b854-44424d238d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:26.345120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef855c-c255-45b7-b854-44424d238d10 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:26.345406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef855c-c255-45b7-b854-44424d238d10 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:26.345679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef855c-c255-45b7-b854-44424d238d10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:26.362988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef855c-c255-45b7-b854-44424d238d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:26.370444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-2480d422-56d0-48aa-89e6-0a39f18988ec None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:26.371640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2480d422-56d0-48aa-89e6-0a39f18988ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-35ef855c-c255-45b7-b854-44424d238d10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:26.377901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:26.379400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:26.380155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 84/160] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:26.386066 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef855c-c255-45b7-b854-44424d238d10 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:26.402732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:26.515601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:26.572104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 77/161] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:26.573378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c000-7eb1-40b5-b3ec-be9ba4b2994c None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:26.573670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c000-7eb1-40b5-b3ec-be9ba4b2994c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:26.573986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c000-7eb1-40b5-b3ec-be9ba4b2994c None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:26.575631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 78/162] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:26.583383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43318d-1525-4246-badc-c20d0fa09811 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:26.583702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43318d-1525-4246-badc-c20d0fa09811 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:26.583986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43318d-1525-4246-badc-c20d0fa09811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:26.614693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef855c-c255-45b7-b854-44424d238d10 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:26.618601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-7a43318d-1525-4246-badc-c20d0fa09811 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:26.621329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7a43318d-1525-4246-badc-c20d0fa09811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:26.685790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a648f-1978-4774-a397-8ed8c5dfac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:26.687121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a648f-1978-4774-a397-8ed8c5dfac54 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:26.688436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a648f-1978-4774-a397-8ed8c5dfac54 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:26.688436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a648f-1978-4774-a397-8ed8c5dfac54 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:26.688978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a648f-1978-4774-a397-8ed8c5dfac54 None admin] RBAC: Adding query filter params (name=member) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:26.689283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a648f-1978-4774-a397-8ed8c5dfac54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:26.690721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a648f-1978-4774-a397-8ed8c5dfac54 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:26.713944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 85/163] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:26.718959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a648f-1978-4774-a397-8ed8c5dfac54 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:26.765067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 79/164] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:26.768251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43318d-1525-4246-badc-c20d0fa09811 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:26.836670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:26.875376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a648f-1978-4774-a397-8ed8c5dfac54 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:26.935441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff36079-5890-4a94-af1b-49d40f6552c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:26.935698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43318d-1525-4246-badc-c20d0fa09811 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:26.937541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff36079-5890-4a94-af1b-49d40f6552c8 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:26.938539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff36079-5890-4a94-af1b-49d40f6552c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:26.939290 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff36079-5890-4a94-af1b-49d40f6552c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:26.951595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:26.970783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff36079-5890-4a94-af1b-49d40f6552c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-6ff36079-5890-4a94-af1b-49d40f6552c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:26.981250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:26.982147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:26.983261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:26.989260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 86/165] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:26.992751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff36079-5890-4a94-af1b-49d40f6552c8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:27.011190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463dc0-208c-4d12-a7d6-fcc3aa0de403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:27.012126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463dc0-208c-4d12-a7d6-fcc3aa0de403 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.012416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463dc0-208c-4d12-a7d6-fcc3aa0de403 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.012704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463dc0-208c-4d12-a7d6-fcc3aa0de403 None admin] PATH_INFO: `/v3/users/b03aa99594304e7f8e065f8b3ac2b405` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.014009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79463dc0-208c-4d12-a7d6-fcc3aa0de403 None admin] RBAC: Authorizing `identity:get_user(user_id=b03aa99594304e7f8e065f8b3ac2b405)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:27.015570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79463dc0-208c-4d12-a7d6-fcc3aa0de403 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:27.017188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 80/166] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:26 2022] GET /identity/v3/users/b03aa99594304e7f8e065f8b3ac2b405 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:27.017967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463dc0-208c-4d12-a7d6-fcc3aa0de403 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:27.115510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff36079-5890-4a94-af1b-49d40f6552c8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:27.145328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:27.167167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2d4bf-465f-46b7-a520-fecc2e46f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:27.168511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2d4bf-465f-46b7-a520-fecc2e46f970 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.169026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2d4bf-465f-46b7-a520-fecc2e46f970 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.169513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2d4bf-465f-46b7-a520-fecc2e46f970 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.186781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2d4bf-465f-46b7-a520-fecc2e46f970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-c6a2d4bf-465f-46b7-a520-fecc2e46f970 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:27.202771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:27.203700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:27.204465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:27.207555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 87/167] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:27.214151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2d4bf-465f-46b7-a520-fecc2e46f970 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:27.290964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463dc0-208c-4d12-a7d6-fcc3aa0de403 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:27.343251 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2d4bf-465f-46b7-a520-fecc2e46f970 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:27.361917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e43a3-9724-485b-abfb-a97bd363a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:27.363382 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e43a3-9724-485b-abfb-a97bd363a519 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.363642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e43a3-9724-485b-abfb-a97bd363a519 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.367123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e43a3-9724-485b-abfb-a97bd363a519 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.367123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e43a3-9724-485b-abfb-a97bd363a519 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:27.367123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e43a3-9724-485b-abfb-a97bd363a519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:27.367123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e43a3-9724-485b-abfb-a97bd363a519 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:27.384084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 81/168] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:27.385052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e43a3-9724-485b-abfb-a97bd363a519 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:27.404402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61004513-468d-4a15-9b2a-cde29242b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:27.405116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61004513-468d-4a15-9b2a-cde29242b641 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.405399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61004513-468d-4a15-9b2a-cde29242b641 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.405729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61004513-468d-4a15-9b2a-cde29242b641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.490557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:27.515189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:27.542868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61004513-468d-4a15-9b2a-cde29242b641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:27.545962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61004513-468d-4a15-9b2a-cde29242b641 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:27.599396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e43a3-9724-485b-abfb-a97bd363a519 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:27.649167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a9a0f-e1ea-498c-af91-c01cb508c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:27.649955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a9a0f-e1ea-498c-af91-c01cb508c775 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.650114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a9a0f-e1ea-498c-af91-c01cb508c775 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.650418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a9a0f-e1ea-498c-af91-c01cb508c775 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.651153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a9a0f-e1ea-498c-af91-c01cb508c775 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:27.651544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a9a0f-e1ea-498c-af91-c01cb508c775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:27.652842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a9a0f-e1ea-498c-af91-c01cb508c775 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:27.673470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 82/169] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:27.675136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444289a-b667-4c7e-a11f-07f0781ad0ee None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.675443 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444289a-b667-4c7e-a11f-07f0781ad0ee None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.675710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444289a-b667-4c7e-a11f-07f0781ad0ee None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.679088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 83/170] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:27.680665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444289a-b667-4c7e-a11f-07f0781ad0ee None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:27.763658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 88/171] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:27.764537 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61004513-468d-4a15-9b2a-cde29242b641 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:27.841420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444289a-b667-4c7e-a11f-07f0781ad0ee None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:27.843973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:27.881331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd48fa-6b74-4299-8296-6bfb7f6b375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:27.882719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd48fa-6b74-4299-8296-6bfb7f6b375a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.883209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd48fa-6b74-4299-8296-6bfb7f6b375a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.883673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd48fa-6b74-4299-8296-6bfb7f6b375a None admin] PATH_INFO: `/v3/users/d16970c992ef45ad92a1879619e5cda1` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.883973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:27.885459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd48fa-6b74-4299-8296-6bfb7f6b375a None admin] RBAC: Authorizing `identity:get_user(user_id=d16970c992ef45ad92a1879619e5cda1)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:27.887302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd48fa-6b74-4299-8296-6bfb7f6b375a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:27.889174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 84/172] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:27 2022] GET /identity/v3/users/d16970c992ef45ad92a1879619e5cda1 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:27.890609 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31b2f2-04f8-4858-bb63-f0f536429cae None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.891133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31b2f2-04f8-4858-bb63-f0f536429cae None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.891640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31b2f2-04f8-4858-bb63-f0f536429cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.899242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61004513-468d-4a15-9b2a-cde29242b641 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:27.909344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3c31b2f2-04f8-4858-bb63-f0f536429cae None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:27.911552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3c31b2f2-04f8-4858-bb63-f0f536429cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:27.938192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a775809-fb4b-49e0-ba2c-ac037bca730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:27.938925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a775809-fb4b-49e0-ba2c-ac037bca730a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.939215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a775809-fb4b-49e0-ba2c-ac037bca730a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.939495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a775809-fb4b-49e0-ba2c-ac037bca730a None admin] PATH_INFO: `/v3/users/b03aa99594304e7f8e065f8b3ac2b405` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.940814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a775809-fb4b-49e0-ba2c-ac037bca730a None admin] RBAC: Authorizing `identity:get_user(user_id=b03aa99594304e7f8e065f8b3ac2b405)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:27.942544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a775809-fb4b-49e0-ba2c-ac037bca730a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:27.944357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 89/173] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:27 2022] GET /identity/v3/users/b03aa99594304e7f8e065f8b3ac2b405 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:27.945040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a775809-fb4b-49e0-ba2c-ac037bca730a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:27.989865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 85/174] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:27.991948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95925c6f-fedf-4ee1-9fed-1cfd50f4cd7b None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:27.992427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95925c6f-fedf-4ee1-9fed-1cfd50f4cd7b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:27.992894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95925c6f-fedf-4ee1-9fed-1cfd50f4cd7b None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:27.994348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 86/175] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:27.999493 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95925c6f-fedf-4ee1-9fed-1cfd50f4cd7b None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:28.059217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a775809-fb4b-49e0-ba2c-ac037bca730a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:28.100474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f66e54-0bc2-4f4d-817d-2107a0b1515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:28.101316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f66e54-0bc2-4f4d-817d-2107a0b1515d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.101587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f66e54-0bc2-4f4d-817d-2107a0b1515d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.101934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f66e54-0bc2-4f4d-817d-2107a0b1515d None admin] PATH_INFO: `/v3/projects/988a379e1cfc4bf38b8071d56d086f63` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.103279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f66e54-0bc2-4f4d-817d-2107a0b1515d None admin] RBAC: Authorizing `identity:get_project(project_id=988a379e1cfc4bf38b8071d56d086f63)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:28.105034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f66e54-0bc2-4f4d-817d-2107a0b1515d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:28.106824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 90/176] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:27 2022] GET /identity/v3/projects/988a379e1cfc4bf38b8071d56d086f63 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:28.107839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f66e54-0bc2-4f4d-817d-2107a0b1515d None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:28.115907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95925c6f-fedf-4ee1-9fed-1cfd50f4cd7b None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:28.117816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:28.139659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:28.155044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b7af-c89c-4801-a99a-2b2ef0f4c807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:28.155838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b7af-c89c-4801-a99a-2b2ef0f4c807 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.156214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b7af-c89c-4801-a99a-2b2ef0f4c807 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.156587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b7af-c89c-4801-a99a-2b2ef0f4c807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.229942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f66e54-0bc2-4f4d-817d-2107a0b1515d None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:28.231574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b7af-c89c-4801-a99a-2b2ef0f4c807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:28.233189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b7af-c89c-4801-a99a-2b2ef0f4c807 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:28.274016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c97e2d-65f8-4a84-9f12-a31bc2d49f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:28.275042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c97e2d-65f8-4a84-9f12-a31bc2d49f6c None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.275473 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c97e2d-65f8-4a84-9f12-a31bc2d49f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.275944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c97e2d-65f8-4a84-9f12-a31bc2d49f6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.341808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 87/177] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:28.343285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ddcb4-ba32-4508-8fde-46da42ff3803 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.343692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ddcb4-ba32-4508-8fde-46da42ff3803 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.344196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ddcb4-ba32-4508-8fde-46da42ff3803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.349506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:28.352185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c97e2d-65f8-4a84-9f12-a31bc2d49f6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:28.354162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c97e2d-65f8-4a84-9f12-a31bc2d49f6c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:28.363566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-981ddcb4-ba32-4508-8fde-46da42ff3803 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:28.365112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-981ddcb4-ba32-4508-8fde-46da42ff3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:28.378494 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:28.437932 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 88/178] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:28.447414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ddcb4-ba32-4508-8fde-46da42ff3803 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:28.465187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 91/179] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:28.466322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c97e2d-65f8-4a84-9f12-a31bc2d49f6c None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:28.561200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ddcb4-ba32-4508-8fde-46da42ff3803 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:28.582212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c97e2d-65f8-4a84-9f12-a31bc2d49f6c None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:28.594320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:28.603587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f34e3d-90b7-4969-b2a6-d21f90792974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:28.604572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34e3d-90b7-4969-b2a6-d21f90792974 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.604863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34e3d-90b7-4969-b2a6-d21f90792974 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.605233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34e3d-90b7-4969-b2a6-d21f90792974 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.610398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:28.619386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f34e3d-90b7-4969-b2a6-d21f90792974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:28.624828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a5a0-ec7e-4341-8941-bc6b2ec0024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:28.625495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a5a0-ec7e-4341-8941-bc6b2ec0024a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.625781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a5a0-ec7e-4341-8941-bc6b2ec0024a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.626059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a5a0-ec7e-4341-8941-bc6b2ec0024a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.626928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a5a0-ec7e-4341-8941-bc6b2ec0024a None admin] RBAC: Adding query filter params (role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=988a379e1cfc4bf38b8071d56d086f63, user.id=b03aa99594304e7f8e065f8b3ac2b405) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:28.627245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a5a0-ec7e-4341-8941-bc6b2ec0024a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:28.629220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a5a0-ec7e-4341-8941-bc6b2ec0024a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-84f34e3d-90b7-4969-b2a6-d21f90792974 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:28.634243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:28.635832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:28.637401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 89/180] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:28.638374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 92/181] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:28 2022] GET /identity/v3/role_assignments?user.id=b03aa99594304e7f8e065f8b3ac2b405&scope.project.id=988a379e1cfc4bf38b8071d56d086f63&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:28.638374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a5a0-ec7e-4341-8941-bc6b2ec0024a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:28.638563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02ecd-558a-473c-a991-c52ea1d702a0 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.638563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02ecd-558a-473c-a991-c52ea1d702a0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.638563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02ecd-558a-473c-a991-c52ea1d702a0 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.646562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 90/182] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:28.646562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02ecd-558a-473c-a991-c52ea1d702a0 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:28.783530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a5a0-ec7e-4341-8941-bc6b2ec0024a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:28.816460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02ecd-558a-473c-a991-c52ea1d702a0 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:28.833176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab34f0-d57d-4e28-bbec-1e54e605bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:28.835010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab34f0-d57d-4e28-bbec-1e54e605bc41 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.835669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab34f0-d57d-4e28-bbec-1e54e605bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.836157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab34f0-d57d-4e28-bbec-1e54e605bc41 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.838986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab34f0-d57d-4e28-bbec-1e54e605bc41 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:28.841359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab34f0-d57d-4e28-bbec-1e54e605bc41 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:28.843414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 93/183] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:28 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:28.844589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab34f0-d57d-4e28-bbec-1e54e605bc41 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:28.878046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf62f3e-319e-4a5a-809d-cd092eea4704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:28.879070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62f3e-319e-4a5a-809d-cd092eea4704 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.879070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62f3e-319e-4a5a-809d-cd092eea4704 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.879353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62f3e-319e-4a5a-809d-cd092eea4704 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.900883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf62f3e-319e-4a5a-809d-cd092eea4704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-cdf62f3e-319e-4a5a-809d-cd092eea4704 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:28.912744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:28.913679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:28.915763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 91/184] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:28.916424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f307f3-0442-47f2-af03-9276821768dc None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:28.916424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f307f3-0442-47f2-af03-9276821768dc None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:28.916752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f307f3-0442-47f2-af03-9276821768dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:28.941573 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d8f307f3-0442-47f2-af03-9276821768dc None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:28.942290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d8f307f3-0442-47f2-af03-9276821768dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:28.949167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:28.999791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.009068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab34f0-d57d-4e28-bbec-1e54e605bc41 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.023013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 92/185] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:29.023013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f307f3-0442-47f2-af03-9276821768dc None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.079146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02013bfa-3140-4d25-9e54-0ca17670c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.080311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02013bfa-3140-4d25-9e54-0ca17670c0f7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.080531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02013bfa-3140-4d25-9e54-0ca17670c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.080952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02013bfa-3140-4d25-9e54-0ca17670c0f7 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.083215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02013bfa-3140-4d25-9e54-0ca17670c0f7 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.084841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02013bfa-3140-4d25-9e54-0ca17670c0f7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.087198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 94/186] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:28 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.087740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02013bfa-3140-4d25-9e54-0ca17670c0f7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.173263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f307f3-0442-47f2-af03-9276821768dc None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.212377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02356ff5-5973-44d1-a261-4c6836705ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.213425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02356ff5-5973-44d1-a261-4c6836705ec7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.213722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02356ff5-5973-44d1-a261-4c6836705ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.214305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02356ff5-5973-44d1-a261-4c6836705ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.215177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02356ff5-5973-44d1-a261-4c6836705ec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:29.215651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02356ff5-5973-44d1-a261-4c6836705ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.217781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02356ff5-5973-44d1-a261-4c6836705ec7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.219006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02013bfa-3140-4d25-9e54-0ca17670c0f7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.229812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 93/187] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.231311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02356ff5-5973-44d1-a261-4c6836705ec7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.249399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.261772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca32c4a-35f5-4d1c-ab5f-3c37fdf5cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.262482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32c4a-35f5-4d1c-ab5f-3c37fdf5cd0d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.262772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32c4a-35f5-4d1c-ab5f-3c37fdf5cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.263051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca32c4a-35f5-4d1c-ab5f-3c37fdf5cd0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.263894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca32c4a-35f5-4d1c-ab5f-3c37fdf5cd0d None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=1f0cac840efb41429100d553f9c6d470, user.id=d16970c992ef45ad92a1879619e5cda1) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:29.264213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca32c4a-35f5-4d1c-ab5f-3c37fdf5cd0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.266043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca32c4a-35f5-4d1c-ab5f-3c37fdf5cd0d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.273172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 95/188] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/role_assignments?user.id=d16970c992ef45ad92a1879619e5cda1&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.273971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca32c4a-35f5-4d1c-ab5f-3c37fdf5cd0d None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.289712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.376617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02356ff5-5973-44d1-a261-4c6836705ec7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.397463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca32c4a-35f5-4d1c-ab5f-3c37fdf5cd0d None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.423017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ac3e-d381-4d53-bb57-84185f7d6c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.423802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ac3e-d381-4d53-bb57-84185f7d6c1b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.424033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ac3e-d381-4d53-bb57-84185f7d6c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.424309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ac3e-d381-4d53-bb57-84185f7d6c1b None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.425136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ac3e-d381-4d53-bb57-84185f7d6c1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:29.425614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ac3e-d381-4d53-bb57-84185f7d6c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.427766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ac3e-d381-4d53-bb57-84185f7d6c1b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.437055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 94/189] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.441991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be87e8-a673-4ae3-b894-da2b6e854078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.443010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be87e8-a673-4ae3-b894-da2b6e854078 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.443293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be87e8-a673-4ae3-b894-da2b6e854078 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.443498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ac3e-d381-4d53-bb57-84185f7d6c1b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.443665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be87e8-a673-4ae3-b894-da2b6e854078 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.445469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be87e8-a673-4ae3-b894-da2b6e854078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.447255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be87e8-a673-4ae3-b894-da2b6e854078 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.449915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 96/190] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.451270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b9583-6726-4fb6-8f97-1e65d5e2b9e2 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.451559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b9583-6726-4fb6-8f97-1e65d5e2b9e2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.451853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b9583-6726-4fb6-8f97-1e65d5e2b9e2 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.457314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 97/191] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:29.457314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b9583-6726-4fb6-8f97-1e65d5e2b9e2 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.541321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.571160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ac3e-d381-4d53-bb57-84185f7d6c1b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.578531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.589974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b9583-6726-4fb6-8f97-1e65d5e2b9e2 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.606844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860b724-c687-43d4-ac61-a7a3d294a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.607506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860b724-c687-43d4-ac61-a7a3d294a1ff None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.607820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860b724-c687-43d4-ac61-a7a3d294a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.608101 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860b724-c687-43d4-ac61-a7a3d294a1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.608944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860b724-c687-43d4-ac61-a7a3d294a1ff None admin] RBAC: Adding query filter params (role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=1f0cac840efb41429100d553f9c6d470, user.id=b03aa99594304e7f8e065f8b3ac2b405) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:29.609256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860b724-c687-43d4-ac61-a7a3d294a1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.610715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860b724-c687-43d4-ac61-a7a3d294a1ff None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.617245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 95/192] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/role_assignments?user.id=b03aa99594304e7f8e065f8b3ac2b405&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.617245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860b724-c687-43d4-ac61-a7a3d294a1ff None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.633425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fedef-4199-49a9-9a58-586a5b93057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.634710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fedef-4199-49a9-9a58-586a5b93057a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.635032 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fedef-4199-49a9-9a58-586a5b93057a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.635346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fedef-4199-49a9-9a58-586a5b93057a None admin] PATH_INFO: `/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.651989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fedef-4199-49a9-9a58-586a5b93057a None admin] RBAC: Authorizing `identity:get_user(user_id=38ce82c31ee9401c8ebe7fb183b5eb1c)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.654094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fedef-4199-49a9-9a58-586a5b93057a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.656250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 98/193] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.662218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fedef-4199-49a9-9a58-586a5b93057a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.770819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860b724-c687-43d4-ac61-a7a3d294a1ff None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.791106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fedef-4199-49a9-9a58-586a5b93057a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:29.809981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.812241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d0050-5409-4ca3-9b4d-6f75f22910f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.813161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0050-5409-4ca3-9b4d-6f75f22910f1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.813446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0050-5409-4ca3-9b4d-6f75f22910f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.813736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0050-5409-4ca3-9b4d-6f75f22910f1 None admin] PATH_INFO: `/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.816777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d0050-5409-4ca3-9b4d-6f75f22910f1 None admin] RBAC: Authorizing `identity:get_user(user_id=38ce82c31ee9401c8ebe7fb183b5eb1c)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.817920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d0050-5409-4ca3-9b4d-6f75f22910f1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.819896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 96/194] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:29.820896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9ff0-ecdb-4a22-adbe-6f3a7aecec6e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.821180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9ff0-ecdb-4a22-adbe-6f3a7aecec6e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.821548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9ff0-ecdb-4a22-adbe-6f3a7aecec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.836055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd1ee3-fe23-480c-a7ca-17f9413b112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:29.836762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd1ee3-fe23-480c-a7ca-17f9413b112c None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:29.837043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd1ee3-fe23-480c-a7ca-17f9413b112c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:29.837321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd1ee3-fe23-480c-a7ca-17f9413b112c None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:29.838043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd1ee3-fe23-480c-a7ca-17f9413b112c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:29.839576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-c9fb9ff0-ecdb-4a22-adbe-6f3a7aecec6e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:29.839684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd1ee3-fe23-480c-a7ca-17f9413b112c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:29.841758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c9fb9ff0-ecdb-4a22-adbe-6f3a7aecec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:29.864290 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 99/195] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:29 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:29.870958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd1ee3-fe23-480c-a7ca-17f9413b112c None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:29.876883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:29.930050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 97/196] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:29.935964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb9ff0-ecdb-4a22-adbe-6f3a7aecec6e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.014582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd1ee3-fe23-480c-a7ca-17f9413b112c None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.060797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197d336-db8a-4910-8f2d-b806486627a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.060797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197d336-db8a-4910-8f2d-b806486627a1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.060797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197d336-db8a-4910-8f2d-b806486627a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.060797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197d336-db8a-4910-8f2d-b806486627a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.078833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb9ff0-ecdb-4a22-adbe-6f3a7aecec6e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.108705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.126675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6c22-765f-4f6e-bd9b-6b24315df76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.127751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6c22-765f-4f6e-bd9b-6b24315df76c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.128267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6c22-765f-4f6e-bd9b-6b24315df76c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.128807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6c22-765f-4f6e-bd9b-6b24315df76c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.152156 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197d336-db8a-4910-8f2d-b806486627a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.153780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197d336-db8a-4910-8f2d-b806486627a1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.182650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.230504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6c22-765f-4f6e-bd9b-6b24315df76c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.232873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6c22-765f-4f6e-bd9b-6b24315df76c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.288984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 100/197] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:30.289937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197d336-db8a-4910-8f2d-b806486627a1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.373018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.387428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 98/198] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:30.388299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6c22-765f-4f6e-bd9b-6b24315df76c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.414628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197d336-db8a-4910-8f2d-b806486627a1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.456349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f32fe2-7ecd-4968-9804-24fd85d4d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.457179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f32fe2-7ecd-4968-9804-24fd85d4d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.457460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f32fe2-7ecd-4968-9804-24fd85d4d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.457730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f32fe2-7ecd-4968-9804-24fd85d4d7a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.469150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f32fe2-7ecd-4968-9804-24fd85d4d7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:30.475658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-d6f32fe2-7ecd-4968-9804-24fd85d4d7a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:30.478257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:30.479145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:30.480561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 101/199] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:30.481694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f32fe2-7ecd-4968-9804-24fd85d4d7a7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.519747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6c22-765f-4f6e-bd9b-6b24315df76c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.566845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8316-196f-4dd7-85d0-d5deea1935f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.568110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8316-196f-4dd7-85d0-d5deea1935f0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.568530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8316-196f-4dd7-85d0-d5deea1935f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.569466 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8316-196f-4dd7-85d0-d5deea1935f0 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.571109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a8316-196f-4dd7-85d0-d5deea1935f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.573757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a8316-196f-4dd7-85d0-d5deea1935f0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.575702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 99/200] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:30.576610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8316-196f-4dd7-85d0-d5deea1935f0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.606264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f32fe2-7ecd-4968-9804-24fd85d4d7a7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.637193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.644415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150044c-20e7-4aa1-867c-4d0c502f1ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.645580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150044c-20e7-4aa1-867c-4d0c502f1ecf None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.646005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150044c-20e7-4aa1-867c-4d0c502f1ecf None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.646586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150044c-20e7-4aa1-867c-4d0c502f1ecf None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.648047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150044c-20e7-4aa1-867c-4d0c502f1ecf None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.649715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150044c-20e7-4aa1-867c-4d0c502f1ecf None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.651946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 102/201] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:30.652909 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150044c-20e7-4aa1-867c-4d0c502f1ecf None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.704955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8316-196f-4dd7-85d0-d5deea1935f0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.742993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a864-607c-4879-a173-dcb85df268e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.743671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a864-607c-4879-a173-dcb85df268e3 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.743958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a864-607c-4879-a173-dcb85df268e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.744240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a864-607c-4879-a173-dcb85df268e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.744993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598a864-607c-4879-a173-dcb85df268e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:30.745303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598a864-607c-4879-a173-dcb85df268e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.746965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598a864-607c-4879-a173-dcb85df268e3 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.749439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:30.758442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 100/202] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:30.759259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a864-607c-4879-a173-dcb85df268e3 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.764783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150044c-20e7-4aa1-867c-4d0c502f1ecf None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:30.806153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1964d3-ae74-49af-9928-dbb9f64d3927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:30.806933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1964d3-ae74-49af-9928-dbb9f64d3927 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:30.807248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1964d3-ae74-49af-9928-dbb9f64d3927 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:30.807930 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1964d3-ae74-49af-9928-dbb9f64d3927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:30.809227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1964d3-ae74-49af-9928-dbb9f64d3927 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92, user.id=38ce82c31ee9401c8ebe7fb183b5eb1c) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:30.809813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1964d3-ae74-49af-9928-dbb9f64d3927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:30.811736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1964d3-ae74-49af-9928-dbb9f64d3927 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:30.822466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 103/203] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/role_assignments?user.id=38ce82c31ee9401c8ebe7fb183b5eb1c&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:30.823694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1964d3-ae74-49af-9928-dbb9f64d3927 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:30.933256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a864-607c-4879-a173-dcb85df268e3 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.013807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:31.036387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb59690-0f10-42e5-a251-f2ac4246388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.037088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb59690-0f10-42e5-a251-f2ac4246388e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.037375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb59690-0f10-42e5-a251-f2ac4246388e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.038198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb59690-0f10-42e5-a251-f2ac4246388e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.039730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb59690-0f10-42e5-a251-f2ac4246388e None admin] RBAC: Adding query filter params (role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92, user.id=38ce82c31ee9401c8ebe7fb183b5eb1c) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:31.039895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb59690-0f10-42e5-a251-f2ac4246388e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.041813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb59690-0f10-42e5-a251-f2ac4246388e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.049549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 101/204] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/role_assignments?user.id=38ce82c31ee9401c8ebe7fb183b5eb1c&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:31.069619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1964d3-ae74-49af-9928-dbb9f64d3927 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.108697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2746df9-b170-4676-99ca-196dcc189b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.109592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2746df9-b170-4676-99ca-196dcc189b66 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.109889 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2746df9-b170-4676-99ca-196dcc189b66 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.110146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2746df9-b170-4676-99ca-196dcc189b66 None admin] PATH_INFO: `/v3/users/7087e1a0862144a7ab1e3082aa5b1c32` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.111510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2746df9-b170-4676-99ca-196dcc189b66 None admin] RBAC: Authorizing `identity:get_user(user_id=7087e1a0862144a7ab1e3082aa5b1c32)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.113523 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2746df9-b170-4676-99ca-196dcc189b66 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.115215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 104/205] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:30 2022] GET /identity/v3/users/7087e1a0862144a7ab1e3082aa5b1c32 => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:31.120841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb59690-0f10-42e5-a251-f2ac4246388e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:31.208226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:31.256999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb59690-0f10-42e5-a251-f2ac4246388e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.294882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb92ffb-6f27-4308-ba7c-fd5e7a413f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.295536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb92ffb-6f27-4308-ba7c-fd5e7a413f16 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.295861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb92ffb-6f27-4308-ba7c-fd5e7a413f16 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.296135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb92ffb-6f27-4308-ba7c-fd5e7a413f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.372154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb92ffb-6f27-4308-ba7c-fd5e7a413f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.374358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb92ffb-6f27-4308-ba7c-fd5e7a413f16 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.448165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:31.486579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 102/206] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:31.493418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2746df9-b170-4676-99ca-196dcc189b66 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:31.629158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2746df9-b170-4676-99ca-196dcc189b66 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.670406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:31.681391 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fe2f8-dcc7-4301-8c7c-6ed20dd1e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.682273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe2f8-dcc7-4301-8c7c-6ed20dd1e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.682578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe2f8-dcc7-4301-8c7c-6ed20dd1e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.682850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fe2f8-dcc7-4301-8c7c-6ed20dd1e4e9 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.684079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fe2f8-dcc7-4301-8c7c-6ed20dd1e4e9 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.685814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fe2f8-dcc7-4301-8c7c-6ed20dd1e4e9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.687547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 105/207] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:31 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:31.694258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb92ffb-6f27-4308-ba7c-fd5e7a413f16 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:31.823944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb92ffb-6f27-4308-ba7c-fd5e7a413f16 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:31.861063 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddab3b6-cbc5-441b-b3bb-1f0a43c45bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:31.861729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddab3b6-cbc5-441b-b3bb-1f0a43c45bd2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:31.864272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddab3b6-cbc5-441b-b3bb-1f0a43c45bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:31.864272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddab3b6-cbc5-441b-b3bb-1f0a43c45bd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:31.864272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddab3b6-cbc5-441b-b3bb-1f0a43c45bd2 None admin] RBAC: Adding query filter params (role.id=35aed85335ec44d7b4e694c59769a360, scope.project.id=1f0cac840efb41429100d553f9c6d470, user.id=7087e1a0862144a7ab1e3082aa5b1c32) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:31.864272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddab3b6-cbc5-441b-b3bb-1f0a43c45bd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:31.865628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddab3b6-cbc5-441b-b3bb-1f0a43c45bd2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:31.873810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 103/208] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:31 2022] GET /identity/v3/role_assignments?user.id=7087e1a0862144a7ab1e3082aa5b1c32&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=35aed85335ec44d7b4e694c59769a360 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:32.375477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51f8f9-c233-41fd-a489-a6ec7f97ba8c None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:32.375899 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51f8f9-c233-41fd-a489-a6ec7f97ba8c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:32.376042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51f8f9-c233-41fd-a489-a6ec7f97ba8c None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:32.377736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 106/209] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:32.384467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620e38-f5a5-4e23-9993-9231ac8b93c2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:32.384994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620e38-f5a5-4e23-9993-9231ac8b93c2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:32.385093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620e38-f5a5-4e23-9993-9231ac8b93c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:32.402621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-7d620e38-f5a5-4e23-9993-9231ac8b93c2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:32.403988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7d620e38-f5a5-4e23-9993-9231ac8b93c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:32.431187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:32.488470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 104/210] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:32.540642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51f8f9-c233-41fd-a489-a6ec7f97ba8c None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:32.613524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6492-db69-4424-9ac6-9617334cdd8f None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:32.613868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6492-db69-4424-9ac6-9617334cdd8f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:32.614189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6492-db69-4424-9ac6-9617334cdd8f None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:32.615612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 105/211] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:32.620911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc87c-800a-4b1c-9716-1931b53523b8 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:32.621198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc87c-800a-4b1c-9716-1931b53523b8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:32.621480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc87c-800a-4b1c-9716-1931b53523b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:32.642354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-cd6bc87c-800a-4b1c-9716-1931b53523b8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:32.644549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-cd6bc87c-800a-4b1c-9716-1931b53523b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:32.665219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51f8f9-c233-41fd-a489-a6ec7f97ba8c None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:32.703581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d79eb-d591-4e0d-8f98-63c47edfe195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:32.704503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d79eb-d591-4e0d-8f98-63c47edfe195 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:32.704949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d79eb-d591-4e0d-8f98-63c47edfe195 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:32.705085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d79eb-d591-4e0d-8f98-63c47edfe195 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:32.717590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d79eb-d591-4e0d-8f98-63c47edfe195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-fb9d79eb-d591-4e0d-8f98-63c47edfe195 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:32.726565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:32.727497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:32.728270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 107/212] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:32.735550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 106/213] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:32.737335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d79eb-d591-4e0d-8f98-63c47edfe195 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:32.767632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc87c-800a-4b1c-9716-1931b53523b8 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:32.813895 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:32.874609 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d79eb-d591-4e0d-8f98-63c47edfe195 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:32.880186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:32.897908 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc87c-800a-4b1c-9716-1931b53523b8 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:32.936986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbd06f-1e56-4041-b41c-f0685e09f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:32.937894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbd06f-1e56-4041-b41c-f0685e09f78d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:32.938237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbd06f-1e56-4041-b41c-f0685e09f78d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:32.938627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbd06f-1e56-4041-b41c-f0685e09f78d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:32.939837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbd06f-1e56-4041-b41c-f0685e09f78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:32.941611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbd06f-1e56-4041-b41c-f0685e09f78d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:32.943076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358a7b-03b5-4d86-8db4-89bdd70c37f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:32.949717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 107/214] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:32.949887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358a7b-03b5-4d86-8db4-89bdd70c37f9 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:32.949887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358a7b-03b5-4d86-8db4-89bdd70c37f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:32.949887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358a7b-03b5-4d86-8db4-89bdd70c37f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:32.949887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d358a7b-03b5-4d86-8db4-89bdd70c37f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:32.949887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d358a7b-03b5-4d86-8db4-89bdd70c37f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:32.950411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d358a7b-03b5-4d86-8db4-89bdd70c37f9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:32.951606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbd06f-1e56-4041-b41c-f0685e09f78d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:32.965714 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 108/215] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:32.972113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358a7b-03b5-4d86-8db4-89bdd70c37f9 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:33.085611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358a7b-03b5-4d86-8db4-89bdd70c37f9 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:33.088014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbd06f-1e56-4041-b41c-f0685e09f78d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:33.111046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.128866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee6a5c-25e7-4d1c-a26c-16dcfbd2aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:33.129423 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b52b0b-ebaa-404f-af22-5cf6b0aee1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:33.130167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee6a5c-25e7-4d1c-a26c-16dcfbd2aa0e None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.130338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b52b0b-ebaa-404f-af22-5cf6b0aee1ac None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.130607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b52b0b-ebaa-404f-af22-5cf6b0aee1ac None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.130886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b52b0b-ebaa-404f-af22-5cf6b0aee1ac None admin] PATH_INFO: `/v3/users/97883a6e4f7c4ea988a1d71e058ebb8f` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.131274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee6a5c-25e7-4d1c-a26c-16dcfbd2aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.131732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee6a5c-25e7-4d1c-a26c-16dcfbd2aa0e None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.132723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee6a5c-25e7-4d1c-a26c-16dcfbd2aa0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:33.134563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee6a5c-25e7-4d1c-a26c-16dcfbd2aa0e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:33.147405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b52b0b-ebaa-404f-af22-5cf6b0aee1ac None admin] RBAC: Authorizing `identity:get_user(user_id=97883a6e4f7c4ea988a1d71e058ebb8f)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:33.148955 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b52b0b-ebaa-404f-af22-5cf6b0aee1ac None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:33.156273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 109/216] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:32 2022] GET /identity/v3/users/97883a6e4f7c4ea988a1d71e058ebb8f => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:33.159090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b52b0b-ebaa-404f-af22-5cf6b0aee1ac None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:33.172491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 108/217] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:32 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:33.302331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b52b0b-ebaa-404f-af22-5cf6b0aee1ac None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:33.349690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb3858-a4ef-4eb3-901e-fcb6ced80481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:33.350757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb3858-a4ef-4eb3-901e-fcb6ced80481 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.351241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb3858-a4ef-4eb3-901e-fcb6ced80481 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.351734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb3858-a4ef-4eb3-901e-fcb6ced80481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.409276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.436458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb3858-a4ef-4eb3-901e-fcb6ced80481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:33.438265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb3858-a4ef-4eb3-901e-fcb6ced80481 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:33.459040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637c2db-5913-4dd5-9742-1538bb78eeb2 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.459542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637c2db-5913-4dd5-9742-1538bb78eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.459639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637c2db-5913-4dd5-9742-1538bb78eeb2 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.460964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 109/218] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:33.466674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1553ab1-6767-48d1-a10b-6cbc3b8eb344 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.466830 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1553ab1-6767-48d1-a10b-6cbc3b8eb344 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.467016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1553ab1-6767-48d1-a10b-6cbc3b8eb344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.486859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-f1553ab1-6767-48d1-a10b-6cbc3b8eb344 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:33.488069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f1553ab1-6767-48d1-a10b-6cbc3b8eb344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:33.492149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.568617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 110/219] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:33.574229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb3858-a4ef-4eb3-901e-fcb6ced80481 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:33.599988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 110/220] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:33.623093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1553ab1-6767-48d1-a10b-6cbc3b8eb344 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:33.682452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.697971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb3858-a4ef-4eb3-901e-fcb6ced80481 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:33.757101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95b56f-c075-45c6-8572-d3045b551b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:33.758046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95b56f-c075-45c6-8572-d3045b551b09 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.758338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95b56f-c075-45c6-8572-d3045b551b09 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.758677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95b56f-c075-45c6-8572-d3045b551b09 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.760596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95b56f-c075-45c6-8572-d3045b551b09 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:33.762089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95b56f-c075-45c6-8572-d3045b551b09 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:33.764025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 111/221] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:33 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:33.773233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1553ab1-6767-48d1-a10b-6cbc3b8eb344 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:33.773607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95b56f-c075-45c6-8572-d3045b551b09 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:33.825253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede45a0-48e8-4fa9-9c12-ce88b11e3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:33.826479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede45a0-48e8-4fa9-9c12-ce88b11e3c1f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.826925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede45a0-48e8-4fa9-9c12-ce88b11e3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.827814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede45a0-48e8-4fa9-9c12-ce88b11e3c1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.840737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:33.846918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede45a0-48e8-4fa9-9c12-ce88b11e3c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-bede45a0-48e8-4fa9-9c12-ce88b11e3c1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:33.857757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:33.858873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:33.859810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:33.862624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 111/222] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:33.864170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125959-f959-40b8-8f8d-ee0bdad7759a None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.864578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125959-f959-40b8-8f8d-ee0bdad7759a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.864974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125959-f959-40b8-8f8d-ee0bdad7759a None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.866637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 112/223] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:33.869896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1125959-f959-40b8-8f8d-ee0bdad7759a None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:33.905860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95b56f-c075-45c6-8572-d3045b551b09 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:33.944084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7904-af1a-4d0c-828e-dd1380c3c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:33.945020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7904-af1a-4d0c-828e-dd1380c3c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.945410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7904-af1a-4d0c-828e-dd1380c3c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.945830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7904-af1a-4d0c-828e-dd1380c3c6c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.947275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7904-af1a-4d0c-828e-dd1380c3c6c0 None admin] RBAC: Adding query filter params (role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92, user.id=97883a6e4f7c4ea988a1d71e058ebb8f) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:33.947595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7904-af1a-4d0c-828e-dd1380c3c6c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:33.949132 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7904-af1a-4d0c-828e-dd1380c3c6c0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:33.957711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 112/224] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:33 2022] GET /identity/v3/role_assignments?user.id=97883a6e4f7c4ea988a1d71e058ebb8f&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:33.966669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929a62b-bf9e-45b1-98ee-b25cab8713fb None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:33.966669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929a62b-bf9e-45b1-98ee-b25cab8713fb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:33.966669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929a62b-bf9e-45b1-98ee-b25cab8713fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:33.994812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-8929a62b-bf9e-45b1-98ee-b25cab8713fb None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:33.996020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8929a62b-bf9e-45b1-98ee-b25cab8713fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:34.006547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:34.030345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1125959-f959-40b8-8f8d-ee0bdad7759a None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.071729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddec8d7-73c2-4882-b9aa-74af74ada96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.072863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec8d7-73c2-4882-b9aa-74af74ada96f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.073147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec8d7-73c2-4882-b9aa-74af74ada96f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.073420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec8d7-73c2-4882-b9aa-74af74ada96f None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.074183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddec8d7-73c2-4882-b9aa-74af74ada96f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:34.074527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddec8d7-73c2-4882-b9aa-74af74ada96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:34.077545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddec8d7-73c2-4882-b9aa-74af74ada96f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:34.098190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 113/225] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:34.112932 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddec8d7-73c2-4882-b9aa-74af74ada96f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.132795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 113/226] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:34.158332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929a62b-bf9e-45b1-98ee-b25cab8713fb None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.217525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:34.261766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddec8d7-73c2-4882-b9aa-74af74ada96f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.304279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b4ca-d1d2-47e0-acc4-4e817b6859cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.305166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b4ca-d1d2-47e0-acc4-4e817b6859cf None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.305452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b4ca-d1d2-47e0-acc4-4e817b6859cf None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.305732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b4ca-d1d2-47e0-acc4-4e817b6859cf None admin] PATH_INFO: `/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.308435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572b4ca-d1d2-47e0-acc4-4e817b6859cf None admin] RBAC: Authorizing `identity:get_user(user_id=38ce82c31ee9401c8ebe7fb183b5eb1c)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:34.310171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572b4ca-d1d2-47e0-acc4-4e817b6859cf None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:34.311872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 114/227] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:34.319450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b4ca-d1d2-47e0-acc4-4e817b6859cf None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.350461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929a62b-bf9e-45b1-98ee-b25cab8713fb None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.419071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe8972-2563-4c3f-bb7a-fcf6793a1a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.419894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe8972-2563-4c3f-bb7a-fcf6793a1a95 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.420176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe8972-2563-4c3f-bb7a-fcf6793a1a95 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.420453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe8972-2563-4c3f-bb7a-fcf6793a1a95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.442724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:34.445611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe8972-2563-4c3f-bb7a-fcf6793a1a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-0fbe8972-2563-4c3f-bb7a-fcf6793a1a95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:34.467128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:34.468164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:34.468964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 114/228] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:34.490248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe8972-2563-4c3f-bb7a-fcf6793a1a95 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.546083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b4ca-d1d2-47e0-acc4-4e817b6859cf None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.588530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:34.602868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7780db-ddf6-43dd-b259-163936f009fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.603996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7780db-ddf6-43dd-b259-163936f009fd None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.604340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7780db-ddf6-43dd-b259-163936f009fd None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.604723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7780db-ddf6-43dd-b259-163936f009fd None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.606419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7780db-ddf6-43dd-b259-163936f009fd None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:34.608482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7780db-ddf6-43dd-b259-163936f009fd None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:34.614534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 115/229] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:34.619402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7780db-ddf6-43dd-b259-163936f009fd None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.658138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe8972-2563-4c3f-bb7a-fcf6793a1a95 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.710313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd076-dcac-4a1b-93c9-cacf2360fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.711102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd076-dcac-4a1b-93c9-cacf2360fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.711453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd076-dcac-4a1b-93c9-cacf2360fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.711735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd076-dcac-4a1b-93c9-cacf2360fbd8 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.715254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd076-dcac-4a1b-93c9-cacf2360fbd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:34.715254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd076-dcac-4a1b-93c9-cacf2360fbd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:34.715254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd076-dcac-4a1b-93c9-cacf2360fbd8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:34.734155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 115/230] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:34.739845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd076-dcac-4a1b-93c9-cacf2360fbd8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:34.814565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7780db-ddf6-43dd-b259-163936f009fd None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:34.884685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffafe21-d733-4298-acbe-7ff142e7251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:34.885595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffafe21-d733-4298-acbe-7ff142e7251b None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:34.885881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffafe21-d733-4298-acbe-7ff142e7251b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:34.886157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffafe21-d733-4298-acbe-7ff142e7251b None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/users/38ce82c31ee9401c8ebe7fb183b5eb1c/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:34.892490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffafe21-d733-4298-acbe-7ff142e7251b None admin] RBAC: Authorizing `identity:create_grant(project_id=e8cc7688c6d046abad0e3ebd04723c92, user_id=38ce82c31ee9401c8ebe7fb183b5eb1c, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:34.894026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffafe21-d733-4298-acbe-7ff142e7251b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:34.914331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:34.916734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 116/231] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:34 2022] PUT /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/users/38ce82c31ee9401c8ebe7fb183b5eb1c/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:36:34.976252 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd076-dcac-4a1b-93c9-cacf2360fbd8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.018532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2e2ff-9ca1-4fc9-9732-e931bb910eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.019396 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2e2ff-9ca1-4fc9-9732-e931bb910eb2 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.019677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2e2ff-9ca1-4fc9-9732-e931bb910eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.019952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2e2ff-9ca1-4fc9-9732-e931bb910eb2 None admin] PATH_INFO: `/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.021183 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2e2ff-9ca1-4fc9-9732-e931bb910eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=38ce82c31ee9401c8ebe7fb183b5eb1c)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:35.022673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2e2ff-9ca1-4fc9-9732-e931bb910eb2 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:35.024315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 116/232] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:34 2022] GET /identity/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:35.030034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffafe21-d733-4298-acbe-7ff142e7251b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:35.098239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:35.147010 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffafe21-d733-4298-acbe-7ff142e7251b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.185947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec82ce6-3137-4662-8502-f045f0b38fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.186938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82ce6-3137-4662-8502-f045f0b38fd8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.187362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82ce6-3137-4662-8502-f045f0b38fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.187640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82ce6-3137-4662-8502-f045f0b38fd8 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.188843 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec82ce6-3137-4662-8502-f045f0b38fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:35.190983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec82ce6-3137-4662-8502-f045f0b38fd8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:35.192692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 117/233] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:35 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:35.198572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2e2ff-9ca1-4fc9-9732-e931bb910eb2 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:35.306193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2e2ff-9ca1-4fc9-9732-e931bb910eb2 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:35.338833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:35.341658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66ecc1-f56d-4b5e-aebe-f1b5c7958531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:35.342800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66ecc1-f56d-4b5e-aebe-f1b5c7958531 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.343272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66ecc1-f56d-4b5e-aebe-f1b5c7958531 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.343558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66ecc1-f56d-4b5e-aebe-f1b5c7958531 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/users/38ce82c31ee9401c8ebe7fb183b5eb1c/roles/85059d55a9ee403aa18b9580d26ccbed` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.346617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66ecc1-f56d-4b5e-aebe-f1b5c7958531 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8cc7688c6d046abad0e3ebd04723c92, user_id=38ce82c31ee9401c8ebe7fb183b5eb1c, role_id=85059d55a9ee403aa18b9580d26ccbed)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:35.348104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66ecc1-f56d-4b5e-aebe-f1b5c7958531 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:35.362775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 117/234] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:35 2022] PUT /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/users/38ce82c31ee9401c8ebe7fb183b5eb1c/roles/85059d55a9ee403aa18b9580d26ccbed => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:35.912790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11c618-4f7b-40a3-a705-94ef448cb8a7 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.913326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11c618-4f7b-40a3-a705-94ef448cb8a7 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.913647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11c618-4f7b-40a3-a705-94ef448cb8a7 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.915451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 118/235] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:35.928124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaefdb-37b5-4b9a-9dce-e4a544a27f04 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:35.928647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaefdb-37b5-4b9a-9dce-e4a544a27f04 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:35.928647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaefdb-37b5-4b9a-9dce-e4a544a27f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:35.950682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-81aaefdb-37b5-4b9a-9dce-e4a544a27f04 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:35.951871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-81aaefdb-37b5-4b9a-9dce-e4a544a27f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:36.006922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc0d2-ce3d-4536-befb-6a9d913c93c0 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.007222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc0d2-ce3d-4536-befb-6a9d913c93c0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.007474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc0d2-ce3d-4536-befb-6a9d913c93c0 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.008866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 119/236] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:36.023631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecf29-931e-460e-b4c8-9780b25a5893 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.024102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecf29-931e-460e-b4c8-9780b25a5893 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.024568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecf29-931e-460e-b4c8-9780b25a5893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.056254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 118/237] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:36.063793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-296ecf29-931e-460e-b4c8-9780b25a5893 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:36.065528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-296ecf29-931e-460e-b4c8-9780b25a5893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:36.113806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaefdb-37b5-4b9a-9dce-e4a544a27f04 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.154462 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 120/238] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:36.178881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecf29-931e-460e-b4c8-9780b25a5893 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.242779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.291842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecf29-931e-460e-b4c8-9780b25a5893 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.329912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554377a-e601-43df-b9dc-dd9de2290554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.331323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554377a-e601-43df-b9dc-dd9de2290554 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.331618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554377a-e601-43df-b9dc-dd9de2290554 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.331894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554377a-e601-43df-b9dc-dd9de2290554 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.333153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554377a-e601-43df-b9dc-dd9de2290554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.334699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554377a-e601-43df-b9dc-dd9de2290554 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.336981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 121/239] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:36.342292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554377a-e601-43df-b9dc-dd9de2290554 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.390247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaefdb-37b5-4b9a-9dce-e4a544a27f04 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.430262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.452964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554377a-e601-43df-b9dc-dd9de2290554 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.464060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e96b8-b743-4215-9853-1a0c06b1c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.464971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e96b8-b743-4215-9853-1a0c06b1c3aa None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.465168 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e96b8-b743-4215-9853-1a0c06b1c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.465446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e96b8-b743-4215-9853-1a0c06b1c3aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.492230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e96b8-b743-4215-9853-1a0c06b1c3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:36.492836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.495124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774a697-243b-4288-aa7e-0693ea0b5ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.495968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774a697-243b-4288-aa7e-0693ea0b5ac9 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.496447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774a697-243b-4288-aa7e-0693ea0b5ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.496937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774a697-243b-4288-aa7e-0693ea0b5ac9 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.497874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774a697-243b-4288-aa7e-0693ea0b5ac9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.499562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774a697-243b-4288-aa7e-0693ea0b5ac9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-4e8e96b8-b743-4215-9853-1a0c06b1c3aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:36.508347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:36.509233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:36.510039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:36.518564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 119/240] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:36.524507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e96b8-b743-4215-9853-1a0c06b1c3aa None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.538755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 122/241] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:36 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:36.696835 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e96b8-b743-4215-9853-1a0c06b1c3aa None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.701937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174048d-28ea-4af6-9a40-4364449e617f None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.702219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174048d-28ea-4af6-9a40-4364449e617f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.702526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174048d-28ea-4af6-9a40-4364449e617f None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.704079 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 123/242] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:36.709995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fd919-6def-4b37-9432-68c5acbc803d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.710292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fd919-6def-4b37-9432-68c5acbc803d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.710676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fd919-6def-4b37-9432-68c5acbc803d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.755403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-526fd919-6def-4b37-9432-68c5acbc803d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:36.756652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-526fd919-6def-4b37-9432-68c5acbc803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:36.761857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc751-040b-4b8e-a8fe-25ae19366006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.762369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc751-040b-4b8e-a8fe-25ae19366006 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.762691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc751-040b-4b8e-a8fe-25ae19366006 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.762970 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc751-040b-4b8e-a8fe-25ae19366006 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.763734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc751-040b-4b8e-a8fe-25ae19366006 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:36.764050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc751-040b-4b8e-a8fe-25ae19366006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.765444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc751-040b-4b8e-a8fe-25ae19366006 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:36.784284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 120/243] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:36.789859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc751-040b-4b8e-a8fe-25ae19366006 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.853665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:36.875710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 124/244] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:36.911412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fd919-6def-4b37-9432-68c5acbc803d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:36.929188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc751-040b-4b8e-a8fe-25ae19366006 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:36.972185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c9f7b-4401-4d40-901d-f8b0eb56284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:36.973070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9f7b-4401-4d40-901d-f8b0eb56284f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:36.973359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9f7b-4401-4d40-901d-f8b0eb56284f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:36.973638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9f7b-4401-4d40-901d-f8b0eb56284f None admin] PATH_INFO: `/v3/users/25242e22f23a4e798b0ffb8643e44318` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:36.998124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c9f7b-4401-4d40-901d-f8b0eb56284f None admin] RBAC: Authorizing `identity:get_user(user_id=25242e22f23a4e798b0ffb8643e44318)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:36.999722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c9f7b-4401-4d40-901d-f8b0eb56284f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.001587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 121/245] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/users/25242e22f23a4e798b0ffb8643e44318 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:37.007613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c9f7b-4401-4d40-901d-f8b0eb56284f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.048568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fd919-6def-4b37-9432-68c5acbc803d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.066764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.098066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bded4-85cf-45ca-a6ea-b5aeae0046d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.099182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bded4-85cf-45ca-a6ea-b5aeae0046d8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.100423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bded4-85cf-45ca-a6ea-b5aeae0046d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.100716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bded4-85cf-45ca-a6ea-b5aeae0046d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.115754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bded4-85cf-45ca-a6ea-b5aeae0046d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-f35bded4-85cf-45ca-a6ea-b5aeae0046d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:37.126044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:37.127603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:37.128467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:37.129855 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 125/246] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:37.134015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.134846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bded4-85cf-45ca-a6ea-b5aeae0046d8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.137510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c9f7b-4401-4d40-901d-f8b0eb56284f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.178126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a162e-c172-4df7-ba5b-3c8b79225226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.178838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a162e-c172-4df7-ba5b-3c8b79225226 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.179130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a162e-c172-4df7-ba5b-3c8b79225226 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.179462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a162e-c172-4df7-ba5b-3c8b79225226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.251760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bded4-85cf-45ca-a6ea-b5aeae0046d8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.259250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a162e-c172-4df7-ba5b-3c8b79225226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.260788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a162e-c172-4df7-ba5b-3c8b79225226 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.292221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7cae-f804-4253-88af-0c3c081da7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.292910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7cae-f804-4253-88af-0c3c081da7c3 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.293197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7cae-f804-4253-88af-0c3c081da7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.293483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7cae-f804-4253-88af-0c3c081da7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.294343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7cae-f804-4253-88af-0c3c081da7c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:37.294807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7cae-f804-4253-88af-0c3c081da7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.296233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7cae-f804-4253-88af-0c3c081da7c3 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.305519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 126/247] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:37.311452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7cae-f804-4253-88af-0c3c081da7c3 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.348227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.364862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.369840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 122/248] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:37.375699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a162e-c172-4df7-ba5b-3c8b79225226 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.427761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7cae-f804-4253-88af-0c3c081da7c3 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.468367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762d705-70ad-4c66-9d40-5966d29a0324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.469256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762d705-70ad-4c66-9d40-5966d29a0324 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.469546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762d705-70ad-4c66-9d40-5966d29a0324 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.469824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762d705-70ad-4c66-9d40-5966d29a0324 None admin] PATH_INFO: `/v3/users/97883a6e4f7c4ea988a1d71e058ebb8f` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.472291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762d705-70ad-4c66-9d40-5966d29a0324 None admin] RBAC: Authorizing `identity:get_user(user_id=97883a6e4f7c4ea988a1d71e058ebb8f)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.473762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762d705-70ad-4c66-9d40-5966d29a0324 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.476301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 127/249] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:37 2022] GET /identity/v3/users/97883a6e4f7c4ea988a1d71e058ebb8f => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:37.481648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762d705-70ad-4c66-9d40-5966d29a0324 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.487986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a162e-c172-4df7-ba5b-3c8b79225226 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.539767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16462b7-f1e5-49ce-b5fb-c19a6c813dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.540939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16462b7-f1e5-49ce-b5fb-c19a6c813dfb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.541362 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16462b7-f1e5-49ce-b5fb-c19a6c813dfb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.541877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16462b7-f1e5-49ce-b5fb-c19a6c813dfb None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.543257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16462b7-f1e5-49ce-b5fb-c19a6c813dfb None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.544949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16462b7-f1e5-49ce-b5fb-c19a6c813dfb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.547276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 123/250] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:37 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:37.575496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16462b7-f1e5-49ce-b5fb-c19a6c813dfb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.608839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.613307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762d705-70ad-4c66-9d40-5966d29a0324 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.656189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d180d2-7459-4637-a461-1587f9a52b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.657304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d180d2-7459-4637-a461-1587f9a52b48 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.657734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d180d2-7459-4637-a461-1587f9a52b48 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.658192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d180d2-7459-4637-a461-1587f9a52b48 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.659648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d180d2-7459-4637-a461-1587f9a52b48 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.661829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d180d2-7459-4637-a461-1587f9a52b48 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.664636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 128/251] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:37 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:37.671551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d180d2-7459-4637-a461-1587f9a52b48 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:37.715260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:37.779636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16462b7-f1e5-49ce-b5fb-c19a6c813dfb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.843372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7bc2a-7df4-4a9e-b41a-44c5b756d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.844047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bc2a-7df4-4a9e-b41a-44c5b756d6eb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.844329 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bc2a-7df4-4a9e-b41a-44c5b756d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.844607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bc2a-7df4-4a9e-b41a-44c5b756d6eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.845453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7bc2a-7df4-4a9e-b41a-44c5b756d6eb None admin] RBAC: Adding query filter params (role.id=35aed85335ec44d7b4e694c59769a360, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92, user.id=25242e22f23a4e798b0ffb8643e44318) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:37.845826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7bc2a-7df4-4a9e-b41a-44c5b756d6eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.847407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7bc2a-7df4-4a9e-b41a-44c5b756d6eb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.854204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 124/252] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:37 2022] GET /identity/v3/role_assignments?user.id=25242e22f23a4e798b0ffb8643e44318&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=35aed85335ec44d7b4e694c59769a360 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:37.863044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d180d2-7459-4637-a461-1587f9a52b48 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:37.925410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf64fab-abbc-4b5a-8cf7-e29082a7eb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:37.926352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf64fab-abbc-4b5a-8cf7-e29082a7eb35 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.926670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf64fab-abbc-4b5a-8cf7-e29082a7eb35 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.926951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf64fab-abbc-4b5a-8cf7-e29082a7eb35 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/users/97883a6e4f7c4ea988a1d71e058ebb8f/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.929178 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf64fab-abbc-4b5a-8cf7-e29082a7eb35 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8cc7688c6d046abad0e3ebd04723c92, user_id=97883a6e4f7c4ea988a1d71e058ebb8f, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:37.930693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf64fab-abbc-4b5a-8cf7-e29082a7eb35 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:37.951513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 129/253] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:37 2022] PUT /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/users/97883a6e4f7c4ea988a1d71e058ebb8f/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:37.976931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0683c9-bd01-4de8-ba3e-ee7b6b1218c8 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.977457 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0683c9-bd01-4de8-ba3e-ee7b6b1218c8 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.977457 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0683c9-bd01-4de8-ba3e-ee7b6b1218c8 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:37.979059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 125/254] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:37.985130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675ae50-cd4b-46d2-8bfd-7655178657bf None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:37.985435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675ae50-cd4b-46d2-8bfd-7655178657bf None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:37.985702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675ae50-cd4b-46d2-8bfd-7655178657bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.009467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1675ae50-cd4b-46d2-8bfd-7655178657bf None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:38.010882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1675ae50-cd4b-46d2-8bfd-7655178657bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:38.049146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:38.113027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 130/255] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:38.161018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0683c9-bd01-4de8-ba3e-ee7b6b1218c8 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:38.283613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0683c9-bd01-4de8-ba3e-ee7b6b1218c8 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:38.315186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:38.320261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943499e-bf98-473d-ac0b-94b1d6870552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:38.321101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943499e-bf98-473d-ac0b-94b1d6870552 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:38.321818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943499e-bf98-473d-ac0b-94b1d6870552 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:38.322504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943499e-bf98-473d-ac0b-94b1d6870552 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.335045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943499e-bf98-473d-ac0b-94b1d6870552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-5943499e-bf98-473d-ac0b-94b1d6870552 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:38.342927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:38.343813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:38.344603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 126/256] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:38.350023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675ae50-cd4b-46d2-8bfd-7655178657bf None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:38.453068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c641b77-c602-4431-8608-f79987a2abd9 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:38.453699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c641b77-c602-4431-8608-f79987a2abd9 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:38.454230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c641b77-c602-4431-8608-f79987a2abd9 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.456993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 127/257] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:38.462572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bbd28-8e54-419f-8bf8-3e2f64fc70c8 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:38.463130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bbd28-8e54-419f-8bf8-3e2f64fc70c8 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:38.463880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bbd28-8e54-419f-8bf8-3e2f64fc70c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.482121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-598bbd28-8e54-419f-8bf8-3e2f64fc70c8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:38.483739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-598bbd28-8e54-419f-8bf8-3e2f64fc70c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:38.532594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675ae50-cd4b-46d2-8bfd-7655178657bf None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:38.617928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b6eb3-2ae0-42d7-9655-4c25137da37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:38.618544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b6eb3-2ae0-42d7-9655-4c25137da37b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:38.618836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b6eb3-2ae0-42d7-9655-4c25137da37b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:38.619118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b6eb3-2ae0-42d7-9655-4c25137da37b None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.619881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b6eb3-2ae0-42d7-9655-4c25137da37b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:38.620189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b6eb3-2ae0-42d7-9655-4c25137da37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:38.621599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b6eb3-2ae0-42d7-9655-4c25137da37b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:38.631221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 131/258] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:38.639385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b6eb3-2ae0-42d7-9655-4c25137da37b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:38.668050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 128/259] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:38.674734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:38.711347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bbd28-8e54-419f-8bf8-3e2f64fc70c8 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:38.802407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b6eb3-2ae0-42d7-9655-4c25137da37b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:38.864187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604349f-f98b-43d1-babf-9b892868999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:38.865106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604349f-f98b-43d1-babf-9b892868999a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:38.865387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604349f-f98b-43d1-babf-9b892868999a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:38.865660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604349f-f98b-43d1-babf-9b892868999a None admin] PATH_INFO: `/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.867000 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604349f-f98b-43d1-babf-9b892868999a None admin] RBAC: Authorizing `identity:get_user(user_id=38ce82c31ee9401c8ebe7fb183b5eb1c)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:38.868512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604349f-f98b-43d1-babf-9b892868999a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:38.875055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 132/260] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:38 2022] GET /identity/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:38.879157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604349f-f98b-43d1-babf-9b892868999a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:38.898580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bbd28-8e54-419f-8bf8-3e2f64fc70c8 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:38.922877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:38.939298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5b47a-d59f-4c4d-88d7-426408490d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:38.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5b47a-d59f-4c4d-88d7-426408490d21 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:38.940573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5b47a-d59f-4c4d-88d7-426408490d21 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:38.940911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5b47a-d59f-4c4d-88d7-426408490d21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:38.952267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5b47a-d59f-4c4d-88d7-426408490d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-93e5b47a-d59f-4c4d-88d7-426408490d21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:38.961197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:38.962172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:38.963026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 129/261] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:38.974221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5b47a-d59f-4c4d-88d7-426408490d21 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.091458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5b47a-d59f-4c4d-88d7-426408490d21 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.104612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.129977 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfd9c5-3dab-4004-953b-db3cd34721fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.130732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfd9c5-3dab-4004-953b-db3cd34721fb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.131024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfd9c5-3dab-4004-953b-db3cd34721fb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.131298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfd9c5-3dab-4004-953b-db3cd34721fb None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.132048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfd9c5-3dab-4004-953b-db3cd34721fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:39.132350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfd9c5-3dab-4004-953b-db3cd34721fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:39.133741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfd9c5-3dab-4004-953b-db3cd34721fb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:39.142794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 130/262] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:39.151600 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfd9c5-3dab-4004-953b-db3cd34721fb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.180356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604349f-f98b-43d1-babf-9b892868999a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.232598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.259696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4331af-1c73-4ba7-b108-1d242a3b40f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.260356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4331af-1c73-4ba7-b108-1d242a3b40f4 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.260640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4331af-1c73-4ba7-b108-1d242a3b40f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.260916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4331af-1c73-4ba7-b108-1d242a3b40f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.364546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfd9c5-3dab-4004-953b-db3cd34721fb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.387523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4331af-1c73-4ba7-b108-1d242a3b40f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:39.388912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4331af-1c73-4ba7-b108-1d242a3b40f4 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:39.453636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef91247-3b04-459d-b923-e11d56e4b0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.454588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef91247-3b04-459d-b923-e11d56e4b0fd None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.455424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef91247-3b04-459d-b923-e11d56e4b0fd None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.455702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef91247-3b04-459d-b923-e11d56e4b0fd None admin] PATH_INFO: `/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.457554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef91247-3b04-459d-b923-e11d56e4b0fd None admin] RBAC: Authorizing `identity:get_user(user_id=38ce82c31ee9401c8ebe7fb183b5eb1c)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:39.459649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef91247-3b04-459d-b923-e11d56e4b0fd None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:39.468294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 131/263] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/users/38ce82c31ee9401c8ebe7fb183b5eb1c => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:39.469204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef91247-3b04-459d-b923-e11d56e4b0fd None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.600342 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.625839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 133/264] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:39.631737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4331af-1c73-4ba7-b108-1d242a3b40f4 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.724504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef91247-3b04-459d-b923-e11d56e4b0fd None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.756229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:39.791884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4331af-1c73-4ba7-b108-1d242a3b40f4 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:39.839112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacd68f-49d2-4014-88f9-0d46eb5dca96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.839781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacd68f-49d2-4014-88f9-0d46eb5dca96 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.840067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacd68f-49d2-4014-88f9-0d46eb5dca96 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.840347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacd68f-49d2-4014-88f9-0d46eb5dca96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.859809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fce20-3cd9-4218-a1f6-c268ab42e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:39.860693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fce20-3cd9-4218-a1f6-c268ab42e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:39.861041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fce20-3cd9-4218-a1f6-c268ab42e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:39.861324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fce20-3cd9-4218-a1f6-c268ab42e6b1 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:39.863369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fce20-3cd9-4218-a1f6-c268ab42e6b1 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:39.865110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fce20-3cd9-4218-a1f6-c268ab42e6b1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:39.866845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 134/265] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:39.872781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fce20-3cd9-4218-a1f6-c268ab42e6b1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:39.995964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacd68f-49d2-4014-88f9-0d46eb5dca96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:39.997602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacd68f-49d2-4014-88f9-0d46eb5dca96 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.035553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:40.124365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 132/266] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:40.131332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacd68f-49d2-4014-88f9-0d46eb5dca96 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.150180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fce20-3cd9-4218-a1f6-c268ab42e6b1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.162702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:40.220342 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdfc8b-d52d-47ba-9ab1-8c3ff6fcf355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.221022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdfc8b-d52d-47ba-9ab1-8c3ff6fcf355 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.221303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdfc8b-d52d-47ba-9ab1-8c3ff6fcf355 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.221577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdfc8b-d52d-47ba-9ab1-8c3ff6fcf355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.222535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdfc8b-d52d-47ba-9ab1-8c3ff6fcf355 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92, user.id=38ce82c31ee9401c8ebe7fb183b5eb1c) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:40.222752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdfc8b-d52d-47ba-9ab1-8c3ff6fcf355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:40.224233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdfc8b-d52d-47ba-9ab1-8c3ff6fcf355 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.239175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 135/267] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:39 2022] GET /identity/v3/role_assignments?user.id=38ce82c31ee9401c8ebe7fb183b5eb1c&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:40.264133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5684f-401e-4509-b99f-787941ee7837 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.264329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5684f-401e-4509-b99f-787941ee7837 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.264605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5684f-401e-4509-b99f-787941ee7837 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.266068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 136/268] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:40.271053 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacd68f-49d2-4014-88f9-0d46eb5dca96 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.271798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258dbf3-a00c-4e5e-8b41-faa4c0746ef8 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.272091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258dbf3-a00c-4e5e-8b41-faa4c0746ef8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.272376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258dbf3-a00c-4e5e-8b41-faa4c0746ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.315970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b258dbf3-a00c-4e5e-8b41-faa4c0746ef8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:40.317688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b258dbf3-a00c-4e5e-8b41-faa4c0746ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:40.318332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c5770-0180-49ec-b5f5-cd4c8ecfba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.319304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c5770-0180-49ec-b5f5-cd4c8ecfba0b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.319586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c5770-0180-49ec-b5f5-cd4c8ecfba0b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.319858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c5770-0180-49ec-b5f5-cd4c8ecfba0b None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.321902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c5770-0180-49ec-b5f5-cd4c8ecfba0b None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:40.324331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c5770-0180-49ec-b5f5-cd4c8ecfba0b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.326409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 133/269] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:40 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:40.335579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c5770-0180-49ec-b5f5-cd4c8ecfba0b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.487253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 137/270] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:40.488963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002903d-9c43-4d9a-957b-31c803be6add None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.489259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002903d-9c43-4d9a-957b-31c803be6add None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.489549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002903d-9c43-4d9a-957b-31c803be6add None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.496525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 138/271] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:40.515361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db675d3-6e95-4d95-bdf8-7ee521888cb1 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.515655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db675d3-6e95-4d95-bdf8-7ee521888cb1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.515940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db675d3-6e95-4d95-bdf8-7ee521888cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.520634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:40.543275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-9db675d3-6e95-4d95-bdf8-7ee521888cb1 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:40.545202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9db675d3-6e95-4d95-bdf8-7ee521888cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:40.555389 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c5770-0180-49ec-b5f5-cd4c8ecfba0b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.596708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81839df-fb9a-4214-915f-836db8dce135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.597421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81839df-fb9a-4214-915f-836db8dce135 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.597705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81839df-fb9a-4214-915f-836db8dce135 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.597981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81839df-fb9a-4214-915f-836db8dce135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.600447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81839df-fb9a-4214-915f-836db8dce135 None admin] RBAC: Adding query filter params (role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92, user.id=38ce82c31ee9401c8ebe7fb183b5eb1c) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:40.600766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81839df-fb9a-4214-915f-836db8dce135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:40.602240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81839df-fb9a-4214-915f-836db8dce135 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.609598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 134/272] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:40 2022] GET /identity/v3/role_assignments?user.id=38ce82c31ee9401c8ebe7fb183b5eb1c&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:40.611313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81839df-fb9a-4214-915f-836db8dce135 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.630765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:40.649893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 139/273] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:40.686247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db675d3-6e95-4d95-bdf8-7ee521888cb1 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.786858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81839df-fb9a-4214-915f-836db8dce135 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.837490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db675d3-6e95-4d95-bdf8-7ee521888cb1 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:40.852989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b54ec5-b705-4b9f-8c6a-1a1f09fda697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.853897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54ec5-b705-4b9f-8c6a-1a1f09fda697 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.854179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54ec5-b705-4b9f-8c6a-1a1f09fda697 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.854482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b54ec5-b705-4b9f-8c6a-1a1f09fda697 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.855701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b54ec5-b705-4b9f-8c6a-1a1f09fda697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:40.857395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b54ec5-b705-4b9f-8c6a-1a1f09fda697 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:40.859129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 135/274] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:40.865299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b54ec5-b705-4b9f-8c6a-1a1f09fda697 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.877616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e362d-6128-4bbd-a1f3-88106d9cd64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:40.878857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e362d-6128-4bbd-a1f3-88106d9cd64b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:40.878857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e362d-6128-4bbd-a1f3-88106d9cd64b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:40.879065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e362d-6128-4bbd-a1f3-88106d9cd64b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:40.886180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:40.902409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e362d-6128-4bbd-a1f3-88106d9cd64b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-b84e362d-6128-4bbd-a1f3-88106d9cd64b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:40.908594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:40.909552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:40.910330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 140/275] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:40.916224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e362d-6128-4bbd-a1f3-88106d9cd64b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:40.971334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.014503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b54ec5-b705-4b9f-8c6a-1a1f09fda697 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.045284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e362d-6128-4bbd-a1f3-88106d9cd64b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.059724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e91f8b-4b5e-4596-9fc3-0ba561bf7154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.060559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e91f8b-4b5e-4596-9fc3-0ba561bf7154 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.060844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e91f8b-4b5e-4596-9fc3-0ba561bf7154 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.061496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e91f8b-4b5e-4596-9fc3-0ba561bf7154 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.062222 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e91f8b-4b5e-4596-9fc3-0ba561bf7154 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:41.063731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e91f8b-4b5e-4596-9fc3-0ba561bf7154 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:41.086284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c6b2a-79e5-4462-a947-999abcaca747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.086984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c6b2a-79e5-4462-a947-999abcaca747 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.087267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c6b2a-79e5-4462-a947-999abcaca747 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.087536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c6b2a-79e5-4462-a947-999abcaca747 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.088074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 136/276] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:36:40 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:41.089761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad81288-d4ce-4cbf-874d-96ccfbf2dd97 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.090264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad81288-d4ce-4cbf-874d-96ccfbf2dd97 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.090692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad81288-d4ce-4cbf-874d-96ccfbf2dd97 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.097236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 137/277] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:41.097775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c6b2a-79e5-4462-a947-999abcaca747 None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:41.097775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c6b2a-79e5-4462-a947-999abcaca747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:41.097775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c6b2a-79e5-4462-a947-999abcaca747 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:41.105348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebe934-551d-4197-b576-c8914d94ca34 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.105348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebe934-551d-4197-b576-c8914d94ca34 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.105348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebe934-551d-4197-b576-c8914d94ca34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.111553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 141/278] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:41.118324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c6b2a-79e5-4462-a947-999abcaca747 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.137978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2cebe934-551d-4197-b576-c8914d94ca34 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:41.139409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2cebe934-551d-4197-b576-c8914d94ca34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:41.244162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.254921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 138/279] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:41.266272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c6b2a-79e5-4462-a947-999abcaca747 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.267900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.277179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebe934-551d-4197-b576-c8914d94ca34 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.308985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752efc-6f8a-47ed-83ab-4196fb5ed3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.309858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752efc-6f8a-47ed-83ab-4196fb5ed3a2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.310140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752efc-6f8a-47ed-83ab-4196fb5ed3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.310478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752efc-6f8a-47ed-83ab-4196fb5ed3a2 None admin] PATH_INFO: `/v3/users/db084bfd7a63485b989d3d797e67541a` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.328250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2752efc-6f8a-47ed-83ab-4196fb5ed3a2 None admin] RBAC: Authorizing `identity:get_user(user_id=db084bfd7a63485b989d3d797e67541a)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:41.329878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2752efc-6f8a-47ed-83ab-4196fb5ed3a2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:41.332034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 142/280] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/users/db084bfd7a63485b989d3d797e67541a => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:41.339793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752efc-6f8a-47ed-83ab-4196fb5ed3a2 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.412923 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebe934-551d-4197-b576-c8914d94ca34 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.458819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb25511-e1f6-4756-8f28-75403523655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.459619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25511-e1f6-4756-8f28-75403523655d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.459921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25511-e1f6-4756-8f28-75403523655d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.460190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25511-e1f6-4756-8f28-75403523655d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.471896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752efc-6f8a-47ed-83ab-4196fb5ed3a2 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.473068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb25511-e1f6-4756-8f28-75403523655d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-8bb25511-e1f6-4756-8f28-75403523655d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:41.481232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:41.482242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:41.483170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 139/281] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:41.484784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403f1a6-c129-4b9b-a400-15971834f83f None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.484784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403f1a6-c129-4b9b-a400-15971834f83f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.484944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403f1a6-c129-4b9b-a400-15971834f83f None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.487553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 140/282] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:41.491203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403f1a6-c129-4b9b-a400-15971834f83f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.523114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457e8ae-a3dd-4577-834f-38a41202a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.523783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457e8ae-a3dd-4577-834f-38a41202a72e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.524071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457e8ae-a3dd-4577-834f-38a41202a72e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.524351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457e8ae-a3dd-4577-834f-38a41202a72e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.525194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457e8ae-a3dd-4577-834f-38a41202a72e None admin] RBAC: Adding query filter params (role.id=78293db45f4044a093a98d4ab1475ca9, user.id=db084bfd7a63485b989d3d797e67541a, scope.system=all) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:41.525513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457e8ae-a3dd-4577-834f-38a41202a72e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:41.527327 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457e8ae-a3dd-4577-834f-38a41202a72e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:41.534274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 143/283] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/role_assignments?user.id=db084bfd7a63485b989d3d797e67541a&scope.system=all&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:41.538601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091c4ff-db52-4177-badf-aff6ce4c084c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.538601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091c4ff-db52-4177-badf-aff6ce4c084c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.538601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091c4ff-db52-4177-badf-aff6ce4c084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.559300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3091c4ff-db52-4177-badf-aff6ce4c084c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:41.561966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3091c4ff-db52-4177-badf-aff6ce4c084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:41.598808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.644500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 144/284] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:41.654728 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.668802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091c4ff-db52-4177-badf-aff6ce4c084c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.733065 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403f1a6-c129-4b9b-a400-15971834f83f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.785372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8bfe-055c-454d-b108-bb1ac0dbe369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.786412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8bfe-055c-454d-b108-bb1ac0dbe369 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.786921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8bfe-055c-454d-b108-bb1ac0dbe369 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.787394 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8bfe-055c-454d-b108-bb1ac0dbe369 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.788405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e8bfe-055c-454d-b108-bb1ac0dbe369 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:41.788953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e8bfe-055c-454d-b108-bb1ac0dbe369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:41.792674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e8bfe-055c-454d-b108-bb1ac0dbe369 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:41.807699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 141/285] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:41.814280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8bfe-055c-454d-b108-bb1ac0dbe369 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:41.904896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091c4ff-db52-4177-badf-aff6ce4c084c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.944708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8bfe-055c-454d-b108-bb1ac0dbe369 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:41.975121 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef073-964d-48a8-a6fd-53c1dc3a37b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:41.976288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef073-964d-48a8-a6fd-53c1dc3a37b2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:41.976760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef073-964d-48a8-a6fd-53c1dc3a37b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:41.977241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef073-964d-48a8-a6fd-53c1dc3a37b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:41.980285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:41.998302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef073-964d-48a8-a6fd-53c1dc3a37b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-391ef073-964d-48a8-a6fd-53c1dc3a37b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:42.006775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:42.007657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:42.008446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 145/286] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:42.012781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78080-a1b6-44bf-994e-7d0342309a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.014655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef073-964d-48a8-a6fd-53c1dc3a37b2 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:42.016018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78080-a1b6-44bf-994e-7d0342309a5b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.021037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78080-a1b6-44bf-994e-7d0342309a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.021454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78080-a1b6-44bf-994e-7d0342309a5b None admin] PATH_INFO: `/v3/users/25242e22f23a4e798b0ffb8643e44318` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.023061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b78080-a1b6-44bf-994e-7d0342309a5b None admin] RBAC: Authorizing `identity:get_user(user_id=25242e22f23a4e798b0ffb8643e44318)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:42.024625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b78080-a1b6-44bf-994e-7d0342309a5b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:42.034932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 142/287] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:41 2022] GET /identity/v3/users/25242e22f23a4e798b0ffb8643e44318 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:42.035972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78080-a1b6-44bf-994e-7d0342309a5b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:42.060959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:42.178011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef073-964d-48a8-a6fd-53c1dc3a37b2 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.213931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad64da-7c39-49c6-b00d-57c8ecdde2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.222707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad64da-7c39-49c6-b00d-57c8ecdde2a7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.223009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad64da-7c39-49c6-b00d-57c8ecdde2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.223291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad64da-7c39-49c6-b00d-57c8ecdde2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.224070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad64da-7c39-49c6-b00d-57c8ecdde2a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:42.224379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad64da-7c39-49c6-b00d-57c8ecdde2a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:42.225762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad64da-7c39-49c6-b00d-57c8ecdde2a7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:42.232700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78080-a1b6-44bf-994e-7d0342309a5b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.241171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 146/288] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:42.246256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad64da-7c39-49c6-b00d-57c8ecdde2a7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:42.292270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b311-099f-4c69-9142-3fe8544b9259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.293809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b311-099f-4c69-9142-3fe8544b9259 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.294366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b311-099f-4c69-9142-3fe8544b9259 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.294834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b311-099f-4c69-9142-3fe8544b9259 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.296738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b311-099f-4c69-9142-3fe8544b9259 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:42.299316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b311-099f-4c69-9142-3fe8544b9259 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:42.302441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 143/289] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:42 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:42.311538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b311-099f-4c69-9142-3fe8544b9259 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:42.333540 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:42.372839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad64da-7c39-49c6-b00d-57c8ecdde2a7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.380932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:42.427915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b311-099f-4c69-9142-3fe8544b9259 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.443409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c2b02-fbee-4044-abad-0dfe02b902df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.444608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c2b02-fbee-4044-abad-0dfe02b902df None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.445189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c2b02-fbee-4044-abad-0dfe02b902df None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.445686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c2b02-fbee-4044-abad-0dfe02b902df None admin] PATH_INFO: `/v3/users/97883a6e4f7c4ea988a1d71e058ebb8f` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.447200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c2b02-fbee-4044-abad-0dfe02b902df None admin] RBAC: Authorizing `identity:get_user(user_id=97883a6e4f7c4ea988a1d71e058ebb8f)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:42.448974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c2b02-fbee-4044-abad-0dfe02b902df None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:42.451204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 147/290] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:42 2022] GET /identity/v3/users/97883a6e4f7c4ea988a1d71e058ebb8f => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:42.457475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c2b02-fbee-4044-abad-0dfe02b902df None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:42.464047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7a616-60d7-4aaa-9e88-ce5aeac68020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.464947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7a616-60d7-4aaa-9e88-ce5aeac68020 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.465229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7a616-60d7-4aaa-9e88-ce5aeac68020 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.465508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7a616-60d7-4aaa-9e88-ce5aeac68020 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/users/25242e22f23a4e798b0ffb8643e44318/roles/35aed85335ec44d7b4e694c59769a360` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.467556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7a616-60d7-4aaa-9e88-ce5aeac68020 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8cc7688c6d046abad0e3ebd04723c92, user_id=25242e22f23a4e798b0ffb8643e44318, role_id=35aed85335ec44d7b4e694c59769a360)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:42.469012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7a616-60d7-4aaa-9e88-ce5aeac68020 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:42.492000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 144/291] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:36:42 2022] PUT /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/users/25242e22f23a4e798b0ffb8643e44318/roles/35aed85335ec44d7b4e694c59769a360 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:42.677782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c2b02-fbee-4044-abad-0dfe02b902df None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:42.740070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e340bf-e570-451d-a25e-2e49f6cdf85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:42.741222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e340bf-e570-451d-a25e-2e49f6cdf85c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:42.741723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e340bf-e570-451d-a25e-2e49f6cdf85c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:42.742207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e340bf-e570-451d-a25e-2e49f6cdf85c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:42.771495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:42.880901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e340bf-e570-451d-a25e-2e49f6cdf85c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:42.882400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e340bf-e570-451d-a25e-2e49f6cdf85c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:43.004782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 148/292] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:43.010413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7a616-60d7-4aaa-9e88-ce5aeac68020 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:43.184304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7a616-60d7-4aaa-9e88-ce5aeac68020 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:43.202343 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:43.225400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a838d7-15fc-4bbf-ae79-4d340edaca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:43.226270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a838d7-15fc-4bbf-ae79-4d340edaca77 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.226587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a838d7-15fc-4bbf-ae79-4d340edaca77 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.226881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a838d7-15fc-4bbf-ae79-4d340edaca77 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.228105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a838d7-15fc-4bbf-ae79-4d340edaca77 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:43.229550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a838d7-15fc-4bbf-ae79-4d340edaca77 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:43.231691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 145/293] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:43 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:43.237526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e340bf-e570-451d-a25e-2e49f6cdf85c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:43.311072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:43.387172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e340bf-e570-451d-a25e-2e49f6cdf85c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:43.436304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a125c1a-28f1-4789-b50d-385492b7543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:43.437226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a125c1a-28f1-4789-b50d-385492b7543a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.437655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a125c1a-28f1-4789-b50d-385492b7543a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.438100 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a125c1a-28f1-4789-b50d-385492b7543a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.439155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a125c1a-28f1-4789-b50d-385492b7543a None admin] RBAC: Adding query filter params (role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92, user.id=97883a6e4f7c4ea988a1d71e058ebb8f) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:43.439620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a125c1a-28f1-4789-b50d-385492b7543a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:43.441211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a125c1a-28f1-4789-b50d-385492b7543a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:43.455142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 149/294] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:43 2022] GET /identity/v3/role_assignments?user.id=97883a6e4f7c4ea988a1d71e058ebb8f&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:43.957387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58370a-c5df-4eee-9682-ac907abed95d None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.957910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58370a-c5df-4eee-9682-ac907abed95d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.957910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58370a-c5df-4eee-9682-ac907abed95d None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.959548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 146/295] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:43.965325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c5814-f97c-4ccf-b114-449e2ac3df55 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.965612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c5814-f97c-4ccf-b114-449e2ac3df55 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.965888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c5814-f97c-4ccf-b114-449e2ac3df55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:43.988145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ff4c5814-f97c-4ccf-b114-449e2ac3df55 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:43.989334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ff4c5814-f97c-4ccf-b114-449e2ac3df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:43.997097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00edf64-a428-4890-9bca-aa36967d8274 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:43.997736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00edf64-a428-4890-9bca-aa36967d8274 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:43.998295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00edf64-a428-4890-9bca-aa36967d8274 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.000359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 147/296] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:44.008026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956068-056e-49aa-8d42-f6dd9fd5c325 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.008656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956068-056e-49aa-8d42-f6dd9fd5c325 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.009144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956068-056e-49aa-8d42-f6dd9fd5c325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.027776 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e2956068-056e-49aa-8d42-f6dd9fd5c325 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:44.029349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e2956068-056e-49aa-8d42-f6dd9fd5c325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:44.098093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 150/297] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:44.121433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c5814-f97c-4ccf-b114-449e2ac3df55 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.132531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 148/298] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:44.154723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2956068-056e-49aa-8d42-f6dd9fd5c325 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.169264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.235842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c5814-f97c-4ccf-b114-449e2ac3df55 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.272605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2956068-056e-49aa-8d42-f6dd9fd5c325 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.273089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24ba83-9225-426c-bdf3-48bcc591588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.274072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24ba83-9225-426c-bdf3-48bcc591588c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.274533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24ba83-9225-426c-bdf3-48bcc591588c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.274953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24ba83-9225-426c-bdf3-48bcc591588c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.277190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24ba83-9225-426c-bdf3-48bcc591588c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.278865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24ba83-9225-426c-bdf3-48bcc591588c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.281045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 151/299] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:44.288432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24ba83-9225-426c-bdf3-48bcc591588c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.291791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.315654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84fbe9-13d5-4500-98ab-d56a61a6a0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.316456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84fbe9-13d5-4500-98ab-d56a61a6a0d6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.316742 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84fbe9-13d5-4500-98ab-d56a61a6a0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.317019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84fbe9-13d5-4500-98ab-d56a61a6a0d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.328194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84fbe9-13d5-4500-98ab-d56a61a6a0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-ae84fbe9-13d5-4500-98ab-d56a61a6a0d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:44.336877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:44.337819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:44.338655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 149/300] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:44.340178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33af29-06c8-4717-90fe-2e5fd732f048 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.340178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33af29-06c8-4717-90fe-2e5fd732f048 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.340178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33af29-06c8-4717-90fe-2e5fd732f048 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.341536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 150/301] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:44.343673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33af29-06c8-4717-90fe-2e5fd732f048 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.402314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24ba83-9225-426c-bdf3-48bcc591588c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.415316 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.444772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0aa39-57d4-4e81-8936-97724a6bc520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.445527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0aa39-57d4-4e81-8936-97724a6bc520 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.445878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0aa39-57d4-4e81-8936-97724a6bc520 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.446092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0aa39-57d4-4e81-8936-97724a6bc520 None admin] PATH_INFO: `/v3/groups` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.446956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0aa39-57d4-4e81-8936-97724a6bc520 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.448265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0aa39-57d4-4e81-8936-97724a6bc520 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.470438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 152/302] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Jun 16 18:36:44 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:36:44.470686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33af29-06c8-4717-90fe-2e5fd732f048 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.476047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184eb01-acf2-4901-a714-e3e853b7e495 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.476344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184eb01-acf2-4901-a714-e3e853b7e495 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.476614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184eb01-acf2-4901-a714-e3e853b7e495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.507310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-c184eb01-acf2-4901-a714-e3e853b7e495 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:44.509903 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c184eb01-acf2-4901-a714-e3e853b7e495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:44.513467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6de46-fb0e-4267-8c84-dce5ae590d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.522409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6de46-fb0e-4267-8c84-dce5ae590d53 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.522409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6de46-fb0e-4267-8c84-dce5ae590d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.522409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6de46-fb0e-4267-8c84-dce5ae590d53 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.522409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6de46-fb0e-4267-8c84-dce5ae590d53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:44.522409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6de46-fb0e-4267-8c84-dce5ae590d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.522409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6de46-fb0e-4267-8c84-dce5ae590d53 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.528218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 151/303] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:44.534592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6de46-fb0e-4267-8c84-dce5ae590d53 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.582690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.601151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 153/304] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:44.630283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184eb01-acf2-4901-a714-e3e853b7e495 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.680985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6de46-fb0e-4267-8c84-dce5ae590d53 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.726632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2293879-4b59-4f93-b8ad-f2683cb72e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.727532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2293879-4b59-4f93-b8ad-f2683cb72e11 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.727812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2293879-4b59-4f93-b8ad-f2683cb72e11 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.728814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2293879-4b59-4f93-b8ad-f2683cb72e11 None admin] PATH_INFO: `/v3/users/1251a50cc00040d9ac704265e3254db8` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.744938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2293879-4b59-4f93-b8ad-f2683cb72e11 None admin] RBAC: Authorizing `identity:get_user(user_id=1251a50cc00040d9ac704265e3254db8)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.746409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2293879-4b59-4f93-b8ad-f2683cb72e11 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.748482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 152/305] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/users/1251a50cc00040d9ac704265e3254db8 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:44.754031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2293879-4b59-4f93-b8ad-f2683cb72e11 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.758169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.763163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184eb01-acf2-4901-a714-e3e853b7e495 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.804779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446e17a-1d1f-4ec3-8752-19745e531e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.805586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446e17a-1d1f-4ec3-8752-19745e531e6b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.805873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446e17a-1d1f-4ec3-8752-19745e531e6b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.806154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446e17a-1d1f-4ec3-8752-19745e531e6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.818684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446e17a-1d1f-4ec3-8752-19745e531e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-5446e17a-1d1f-4ec3-8752-19745e531e6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:44.827017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:44.828060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:44.828859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 154/306] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:44.836724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446e17a-1d1f-4ec3-8752-19745e531e6b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:44.888813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:44.897828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2293879-4b59-4f93-b8ad-f2683cb72e11 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:44.935016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59190674-ed2a-40a1-a4b1-8e3626c703d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:44.935691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59190674-ed2a-40a1-a4b1-8e3626c703d7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:44.935980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59190674-ed2a-40a1-a4b1-8e3626c703d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:44.936277 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59190674-ed2a-40a1-a4b1-8e3626c703d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:44.937168 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59190674-ed2a-40a1-a4b1-8e3626c703d7 None admin] RBAC: Adding query filter params (role.id=35aed85335ec44d7b4e694c59769a360, user.id=1251a50cc00040d9ac704265e3254db8, scope.system=all) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:44.937440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59190674-ed2a-40a1-a4b1-8e3626c703d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:44.938991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59190674-ed2a-40a1-a4b1-8e3626c703d7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:44.950414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 153/307] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/role_assignments?user.id=1251a50cc00040d9ac704265e3254db8&scope.system=all&role.id=35aed85335ec44d7b4e694c59769a360 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:44.973418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446e17a-1d1f-4ec3-8752-19745e531e6b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.013481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced11860-6ead-400c-a862-d67c25032f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.014099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced11860-6ead-400c-a862-d67c25032f97 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.014425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced11860-6ead-400c-a862-d67c25032f97 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.014723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced11860-6ead-400c-a862-d67c25032f97 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.015535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced11860-6ead-400c-a862-d67c25032f97 None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:45.015853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced11860-6ead-400c-a862-d67c25032f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.017983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced11860-6ead-400c-a862-d67c25032f97 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.029198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 155/308] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:45.035224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59190674-ed2a-40a1-a4b1-8e3626c703d7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.097036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfa070-2b26-4238-b602-2d067aa48fb3 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.097481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfa070-2b26-4238-b602-2d067aa48fb3 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.097891 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfa070-2b26-4238-b602-2d067aa48fb3 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.100981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 156/309] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:45.109383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4a120-6a08-4747-ad5e-20f8be8642f7 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.109849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4a120-6a08-4747-ad5e-20f8be8642f7 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.110367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4a120-6a08-4747-ad5e-20f8be8642f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.137937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-94b4a120-6a08-4747-ad5e-20f8be8642f7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:45.139856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-94b4a120-6a08-4747-ad5e-20f8be8642f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:45.165369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.183072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59190674-ed2a-40a1-a4b1-8e3626c703d7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.227565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff63e7-e664-4cf1-83bd-7a3797ae71e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.229097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff63e7-e664-4cf1-83bd-7a3797ae71e6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.229599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff63e7-e664-4cf1-83bd-7a3797ae71e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.230602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff63e7-e664-4cf1-83bd-7a3797ae71e6 None admin] PATH_INFO: `/v3/users/db084bfd7a63485b989d3d797e67541a` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.232212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff63e7-e664-4cf1-83bd-7a3797ae71e6 None admin] RBAC: Authorizing `identity:get_user(user_id=db084bfd7a63485b989d3d797e67541a)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.233880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff63e7-e664-4cf1-83bd-7a3797ae71e6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.237661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 154/310] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/users/db084bfd7a63485b989d3d797e67541a => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:45.244522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff63e7-e664-4cf1-83bd-7a3797ae71e6 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.253423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 157/311] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:45.276631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4a120-6a08-4747-ad5e-20f8be8642f7 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.326866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.365694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff63e7-e664-4cf1-83bd-7a3797ae71e6 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.387862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4a120-6a08-4747-ad5e-20f8be8642f7 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.406639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef3d0-ce6e-4bf6-8050-cbbabbc48e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.408487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef3d0-ce6e-4bf6-8050-cbbabbc48e2d None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.408975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef3d0-ce6e-4bf6-8050-cbbabbc48e2d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.409452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef3d0-ce6e-4bf6-8050-cbbabbc48e2d None admin] PATH_INFO: `/v3/system/users/db084bfd7a63485b989d3d797e67541a/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.411650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ef3d0-ce6e-4bf6-8050-cbbabbc48e2d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=db084bfd7a63485b989d3d797e67541a, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.413444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ef3d0-ce6e-4bf6-8050-cbbabbc48e2d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.425460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 155/312] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Jun 16 18:36:45 2022] PUT /identity/v3/system/users/db084bfd7a63485b989d3d797e67541a/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:45.435628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88cd1-3794-459d-8256-3b8081913362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.437310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88cd1-3794-459d-8256-3b8081913362 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.437904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88cd1-3794-459d-8256-3b8081913362 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.438490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88cd1-3794-459d-8256-3b8081913362 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.453660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d88cd1-3794-459d-8256-3b8081913362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-f3d88cd1-3794-459d-8256-3b8081913362 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:45.463362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:45.464312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:45.465155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:45.467412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 158/313] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:45.474054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef3d0-ce6e-4bf6-8050-cbbabbc48e2d None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.600185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.610567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef3d0-ce6e-4bf6-8050-cbbabbc48e2d None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.648755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23721f-7835-47af-9122-7b07c213b07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.649443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23721f-7835-47af-9122-7b07c213b07d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.649732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23721f-7835-47af-9122-7b07c213b07d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.650013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23721f-7835-47af-9122-7b07c213b07d None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.650815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23721f-7835-47af-9122-7b07c213b07d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:45.651123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23721f-7835-47af-9122-7b07c213b07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.652544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23721f-7835-47af-9122-7b07c213b07d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.663387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 156/314] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:45.669000 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88cd1-3794-459d-8256-3b8081913362 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.685388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:45.793773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88cd1-3794-459d-8256-3b8081913362 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.836902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10af5a-a721-4d4f-9b58-38d9b851d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.837842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10af5a-a721-4d4f-9b58-38d9b851d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:45.838131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10af5a-a721-4d4f-9b58-38d9b851d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:45.838463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10af5a-a721-4d4f-9b58-38d9b851d2a9 None admin] PATH_INFO: `/v3/users/25242e22f23a4e798b0ffb8643e44318` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:45.839860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10af5a-a721-4d4f-9b58-38d9b851d2a9 None admin] RBAC: Authorizing `identity:get_user(user_id=25242e22f23a4e798b0ffb8643e44318)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:45.841316 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10af5a-a721-4d4f-9b58-38d9b851d2a9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:45.843364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 159/315] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/users/25242e22f23a4e798b0ffb8643e44318 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:45.849119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23721f-7835-47af-9122-7b07c213b07d None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:45.962372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23721f-7835-47af-9122-7b07c213b07d None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:45.998863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172525-ba4f-4ffc-b7f2-1e071b0ead77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:45.999896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172525-ba4f-4ffc-b7f2-1e071b0ead77 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.000372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172525-ba4f-4ffc-b7f2-1e071b0ead77 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.001400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172525-ba4f-4ffc-b7f2-1e071b0ead77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.025251 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:46.077227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172525-ba4f-4ffc-b7f2-1e071b0ead77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:46.080712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172525-ba4f-4ffc-b7f2-1e071b0ead77 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:46.197148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 157/316] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:46.203241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10af5a-a721-4d4f-9b58-38d9b851d2a9 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:46.292280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:46.317680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10af5a-a721-4d4f-9b58-38d9b851d2a9 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:46.353476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacab7a2-063e-4c49-9da5-b77badf039d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:46.354353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacab7a2-063e-4c49-9da5-b77badf039d1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.354667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacab7a2-063e-4c49-9da5-b77badf039d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.354949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacab7a2-063e-4c49-9da5-b77badf039d1 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.356172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacab7a2-063e-4c49-9da5-b77badf039d1 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:46.357626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacab7a2-063e-4c49-9da5-b77badf039d1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:46.359546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 160/317] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:46 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:46.366481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172525-ba4f-4ffc-b7f2-1e071b0ead77 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:46.424029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:46.477630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172525-ba4f-4ffc-b7f2-1e071b0ead77 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:46.527978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1c6c3-81fe-4b1d-a6f6-ac7aa15dc0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:46.529028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1c6c3-81fe-4b1d-a6f6-ac7aa15dc0ec None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.529511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1c6c3-81fe-4b1d-a6f6-ac7aa15dc0ec None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.530010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1c6c3-81fe-4b1d-a6f6-ac7aa15dc0ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.531081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1c6c3-81fe-4b1d-a6f6-ac7aa15dc0ec None admin] RBAC: Adding query filter params (role.id=35aed85335ec44d7b4e694c59769a360, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92, user.id=25242e22f23a4e798b0ffb8643e44318) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:46.531608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1c6c3-81fe-4b1d-a6f6-ac7aa15dc0ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:46.533812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1c6c3-81fe-4b1d-a6f6-ac7aa15dc0ec None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:46.541256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 158/318] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:36:46 2022] GET /identity/v3/role_assignments?user.id=25242e22f23a4e798b0ffb8643e44318&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=35aed85335ec44d7b4e694c59769a360 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:46.818529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9f46-00b4-4d79-aaea-f50e64b5b39e None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.819040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9f46-00b4-4d79-aaea-f50e64b5b39e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.819141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9f46-00b4-4d79-aaea-f50e64b5b39e None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.820684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 161/319] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:46.825959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ebac-c148-4463-b57e-34cfae4deffe None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:46.826340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ebac-c148-4463-b57e-34cfae4deffe None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:46.826731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ebac-c148-4463-b57e-34cfae4deffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:46.844032 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c7b3ebac-c148-4463-b57e-34cfae4deffe None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:46.845795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c7b3ebac-c148-4463-b57e-34cfae4deffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:46.922063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 159/320] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:46.944798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9f46-00b4-4d79-aaea-f50e64b5b39e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.056275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9f46-00b4-4d79-aaea-f50e64b5b39e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:47.094916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad95f7f-2b03-4bc9-a12f-a848b596a4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:47.096123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad95f7f-2b03-4bc9-a12f-a848b596a4b7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.096416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad95f7f-2b03-4bc9-a12f-a848b596a4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.096697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad95f7f-2b03-4bc9-a12f-a848b596a4b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.098194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad95f7f-2b03-4bc9-a12f-a848b596a4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:47.099669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad95f7f-2b03-4bc9-a12f-a848b596a4b7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:47.102561 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 162/321] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:36:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:47.107518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ebac-c148-4463-b57e-34cfae4deffe None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.160866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:47.172341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe070fc2-e4b1-47f9-be1c-9321a6a48f16 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.172686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe070fc2-e4b1-47f9-be1c-9321a6a48f16 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.172930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe070fc2-e4b1-47f9-be1c-9321a6a48f16 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.174487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 163/322] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:47.179783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486d9e-be72-41aa-a927-1e04850d27a5 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.180069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486d9e-be72-41aa-a927-1e04850d27a5 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.180517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486d9e-be72-41aa-a927-1e04850d27a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.197652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-11486d9e-be72-41aa-a927-1e04850d27a5 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:47.198932 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-11486d9e-be72-41aa-a927-1e04850d27a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:47.208867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:47.239919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ebac-c148-4463-b57e-34cfae4deffe None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:47.277848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493cd52-55d4-45ac-82a4-7cacbaf5f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:47.278571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493cd52-55d4-45ac-82a4-7cacbaf5f6f0 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.278856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493cd52-55d4-45ac-82a4-7cacbaf5f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.279131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493cd52-55d4-45ac-82a4-7cacbaf5f6f0 None admin] PATH_INFO: `/v3/groups` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.279837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493cd52-55d4-45ac-82a4-7cacbaf5f6f0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:47.281333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493cd52-55d4-45ac-82a4-7cacbaf5f6f0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:47.299944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 160/323] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Jun 16 18:36:47 2022] POST /identity/v3/groups => generated 226 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:36:47.303883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 164/324] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:47.327634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493cd52-55d4-45ac-82a4-7cacbaf5f6f0 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.451245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493cd52-55d4-45ac-82a4-7cacbaf5f6f0 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:47.459750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:47.493104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a756e-346e-464d-9f03-8f624a0592c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:47.493916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a756e-346e-464d-9f03-8f624a0592c2 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.494216 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a756e-346e-464d-9f03-8f624a0592c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.494511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a756e-346e-464d-9f03-8f624a0592c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.510340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a756e-346e-464d-9f03-8f624a0592c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-9e9a756e-346e-464d-9f03-8f624a0592c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:47.518927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:47.519840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:47.520752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 161/325] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:47.526168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486d9e-be72-41aa-a927-1e04850d27a5 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.637311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486d9e-be72-41aa-a927-1e04850d27a5 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:47.680503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7f767-b195-4d44-a56c-8bbd51d04dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:47.681197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7f767-b195-4d44-a56c-8bbd51d04dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.681486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7f767-b195-4d44-a56c-8bbd51d04dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.681763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7f767-b195-4d44-a56c-8bbd51d04dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.682834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7f767-b195-4d44-a56c-8bbd51d04dd7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:47.683147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7f767-b195-4d44-a56c-8bbd51d04dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:47.684586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7f767-b195-4d44-a56c-8bbd51d04dd7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:47.694533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 165/326] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:47.699943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a756e-346e-464d-9f03-8f624a0592c2 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.716751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37489428-f431-4f68-a2d2-b9bef16c42c7 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.717237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37489428-f431-4f68-a2d2-b9bef16c42c7 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.717524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37489428-f431-4f68-a2d2-b9bef16c42c7 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.719490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 166/327] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:47.725579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1820-ffc0-4c37-b65e-b956b9ee8d18 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.725855 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1820-ffc0-4c37-b65e-b956b9ee8d18 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.726139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1820-ffc0-4c37-b65e-b956b9ee8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.732321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:47.745967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-f8bd1820-ffc0-4c37-b65e-b956b9ee8d18 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:47.747480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f8bd1820-ffc0-4c37-b65e-b956b9ee8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:47.843589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 167/328] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:47.852777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a756e-346e-464d-9f03-8f624a0592c2 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:47.868482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1820-ffc0-4c37-b65e-b956b9ee8d18 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.898212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9e40d-0c35-4e1a-b8f1-cd24db72fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:47.899672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9e40d-0c35-4e1a-b8f1-cd24db72fd95 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:47.900539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9e40d-0c35-4e1a-b8f1-cd24db72fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:47.901287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9e40d-0c35-4e1a-b8f1-cd24db72fd95 None admin] PATH_INFO: `/v3/users/1251a50cc00040d9ac704265e3254db8` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:47.903504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9e40d-0c35-4e1a-b8f1-cd24db72fd95 None admin] RBAC: Authorizing `identity:get_user(user_id=1251a50cc00040d9ac704265e3254db8)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:47.905503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9e40d-0c35-4e1a-b8f1-cd24db72fd95 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:47.908946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 162/329] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:47 2022] GET /identity/v3/users/1251a50cc00040d9ac704265e3254db8 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:47.914672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9e40d-0c35-4e1a-b8f1-cd24db72fd95 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:47.966020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:47.995106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1820-ffc0-4c37-b65e-b956b9ee8d18 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:48.049695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53286-f252-4634-a07a-56d058dd3074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:48.050709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53286-f252-4634-a07a-56d058dd3074 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.050998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53286-f252-4634-a07a-56d058dd3074 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.051277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b53286-f252-4634-a07a-56d058dd3074 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.053899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:48.054241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9e40d-0c35-4e1a-b8f1-cd24db72fd95 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:48.066837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b53286-f252-4634-a07a-56d058dd3074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-f8b53286-f252-4634-a07a-56d058dd3074 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:48.076104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:48.077059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:48.077842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:48.082333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 168/330] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:48.083645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53286-f252-4634-a07a-56d058dd3074 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:48.103861 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62bfc0-08ed-44f1-b61b-2564c9a18fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:48.105594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62bfc0-08ed-44f1-b61b-2564c9a18fa8 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.106131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62bfc0-08ed-44f1-b61b-2564c9a18fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.106577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62bfc0-08ed-44f1-b61b-2564c9a18fa8 None admin] PATH_INFO: `/v3/system/users/1251a50cc00040d9ac704265e3254db8/roles/35aed85335ec44d7b4e694c59769a360` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.108963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62bfc0-08ed-44f1-b61b-2564c9a18fa8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1251a50cc00040d9ac704265e3254db8, role_id=35aed85335ec44d7b4e694c59769a360)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:48.111640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62bfc0-08ed-44f1-b61b-2564c9a18fa8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:48.121661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 163/331] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Jun 16 18:36:47 2022] PUT /identity/v3/system/users/1251a50cc00040d9ac704265e3254db8/roles/35aed85335ec44d7b4e694c59769a360 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:36:48.233265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b53286-f252-4634-a07a-56d058dd3074 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:48.277174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6df50-2bd3-4acf-b185-192b59b507e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:48.277823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6df50-2bd3-4acf-b185-192b59b507e5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.278107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6df50-2bd3-4acf-b185-192b59b507e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.278409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6df50-2bd3-4acf-b185-192b59b507e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.279167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6df50-2bd3-4acf-b185-192b59b507e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:48.279471 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6df50-2bd3-4acf-b185-192b59b507e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:48.280880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6df50-2bd3-4acf-b185-192b59b507e5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:48.292708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 169/332] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:48.298529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62bfc0-08ed-44f1-b61b-2564c9a18fa8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:48.415257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:48.423478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62bfc0-08ed-44f1-b61b-2564c9a18fa8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:48.480874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334eb66-1022-4177-a839-028bab8ac089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:48.481757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334eb66-1022-4177-a839-028bab8ac089 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.482075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334eb66-1022-4177-a839-028bab8ac089 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.482353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334eb66-1022-4177-a839-028bab8ac089 None admin] PATH_INFO: `/v3/users/db084bfd7a63485b989d3d797e67541a` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.487190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334eb66-1022-4177-a839-028bab8ac089 None admin] RBAC: Authorizing `identity:get_user(user_id=db084bfd7a63485b989d3d797e67541a)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:48.488636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334eb66-1022-4177-a839-028bab8ac089 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:48.490666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 164/333] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:48 2022] GET /identity/v3/users/db084bfd7a63485b989d3d797e67541a => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:48.506483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6df50-2bd3-4acf-b185-192b59b507e5 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:48.602616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:48.677299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6df50-2bd3-4acf-b185-192b59b507e5 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:48.720094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dbc8b-a2bb-440e-8b66-8ba3defcadf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:48.721162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dbc8b-a2bb-440e-8b66-8ba3defcadf8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:48.721647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dbc8b-a2bb-440e-8b66-8ba3defcadf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:48.722120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dbc8b-a2bb-440e-8b66-8ba3defcadf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:48.723299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dbc8b-a2bb-440e-8b66-8ba3defcadf8 None admin] RBAC: Adding query filter params (role.id=78293db45f4044a093a98d4ab1475ca9, user.id=db084bfd7a63485b989d3d797e67541a, scope.system=all) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:48.723842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dbc8b-a2bb-440e-8b66-8ba3defcadf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:48.725497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dbc8b-a2bb-440e-8b66-8ba3defcadf8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:48.739741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 170/334] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jun 16 18:36:48 2022] GET /identity/v3/role_assignments?user.id=db084bfd7a63485b989d3d797e67541a&scope.system=all&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 510 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:49.956954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e24e6-bb01-449b-b327-fc3968f34920 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:49.957475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e24e6-bb01-449b-b327-fc3968f34920 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:49.957551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e24e6-bb01-449b-b327-fc3968f34920 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:49.959158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 165/335] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:49.976523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e1e62-c65e-4fca-b668-76da9f8c6735 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:49.977029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e1e62-c65e-4fca-b668-76da9f8c6735 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:49.977130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e1e62-c65e-4fca-b668-76da9f8c6735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:49.999423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-119e1e62-c65e-4fca-b668-76da9f8c6735 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:50.000726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-119e1e62-c65e-4fca-b668-76da9f8c6735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:50.084684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 171/336] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:50.126350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e24e6-bb01-449b-b327-fc3968f34920 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:50.255202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e24e6-bb01-449b-b327-fc3968f34920 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:50.294299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc481930-9563-479c-8ed3-49d8ea840556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:50.295144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc481930-9563-479c-8ed3-49d8ea840556 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.295430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc481930-9563-479c-8ed3-49d8ea840556 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.295703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc481930-9563-479c-8ed3-49d8ea840556 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.313141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc481930-9563-479c-8ed3-49d8ea840556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-bc481930-9563-479c-8ed3-49d8ea840556 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:50.321071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:50.322005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:50.322817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:50.326804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 166/337] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:50.330096 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e1e62-c65e-4fca-b668-76da9f8c6735 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:50.384917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:50.454464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e1e62-c65e-4fca-b668-76da9f8c6735 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:50.512022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f553ca4-fde8-4311-9937-f933fb49b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:50.513029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553ca4-fde8-4311-9937-f933fb49b66b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.513029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553ca4-fde8-4311-9937-f933fb49b66b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.513293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553ca4-fde8-4311-9937-f933fb49b66b None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.513927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f553ca4-fde8-4311-9937-f933fb49b66b None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:50.514239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f553ca4-fde8-4311-9937-f933fb49b66b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:50.515685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f553ca4-fde8-4311-9937-f933fb49b66b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:50.534848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 172/338] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:50.540524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc481930-9563-479c-8ed3-49d8ea840556 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:50.577261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:50.682866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc481930-9563-479c-8ed3-49d8ea840556 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:50.722655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5e463-4011-4662-a3d5-bb9f6b52d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:50.723313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5e463-4011-4662-a3d5-bb9f6b52d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:50.723592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5e463-4011-4662-a3d5-bb9f6b52d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:50.723865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5e463-4011-4662-a3d5-bb9f6b52d6e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:50.805415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5e463-4011-4662-a3d5-bb9f6b52d6e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:50.806870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5e463-4011-4662-a3d5-bb9f6b52d6e4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:50.838840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:50.924139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 167/339] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:50.930559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f553ca4-fde8-4311-9937-f933fb49b66b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.078984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f553ca4-fde8-4311-9937-f933fb49b66b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.087004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:51.124918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f3fa7-7a42-406f-b149-5d5dee515c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.126343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f3fa7-7a42-406f-b149-5d5dee515c55 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.127045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f3fa7-7a42-406f-b149-5d5dee515c55 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.127290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f3fa7-7a42-406f-b149-5d5dee515c55 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.128561 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f3fa7-7a42-406f-b149-5d5dee515c55 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:51.130014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f3fa7-7a42-406f-b149-5d5dee515c55 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:51.132077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 173/340] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:50 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:51.137593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5e463-4011-4662-a3d5-bb9f6b52d6e4 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.214353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3335-4c05-4d46-a59b-eed163f90ded None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.214690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3335-4c05-4d46-a59b-eed163f90ded None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.214951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f3335-4c05-4d46-a59b-eed163f90ded None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.216352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 174/341] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:51.228417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956744b-1feb-4a84-9104-1aa7ef794d70 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.228742 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956744b-1feb-4a84-9104-1aa7ef794d70 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.228990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956744b-1feb-4a84-9104-1aa7ef794d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.261574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-2956744b-1feb-4a84-9104-1aa7ef794d70 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:51.262951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2956744b-1feb-4a84-9104-1aa7ef794d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:51.311297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5e463-4011-4662-a3d5-bb9f6b52d6e4 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.383297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 175/342] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 18:36:51.384067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:51.401092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98e0d1-8f34-4b4d-bd7a-db673ba28a00 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.401399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98e0d1-8f34-4b4d-bd7a-db673ba28a00 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.401661 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98e0d1-8f34-4b4d-bd7a-db673ba28a00 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.403346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 176/343] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:51.405596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b497665-f511-407e-ad82-ae7868a7829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.406563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b497665-f511-407e-ad82-ae7868a7829f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.406848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b497665-f511-407e-ad82-ae7868a7829f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.407122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b497665-f511-407e-ad82-ae7868a7829f None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.409726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed23ed-16c5-43d4-b3ba-248adbe0e3d8 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.410019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed23ed-16c5-43d4-b3ba-248adbe0e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.410305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed23ed-16c5-43d4-b3ba-248adbe0e3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.413856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b497665-f511-407e-ad82-ae7868a7829f None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:51.415367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b497665-f511-407e-ad82-ae7868a7829f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:51.417390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 168/344] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:51.425990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b497665-f511-407e-ad82-ae7868a7829f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.437428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4aed23ed-16c5-43d4-b3ba-248adbe0e3d8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:51.439299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4aed23ed-16c5-43d4-b3ba-248adbe0e3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:51.533905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 177/345] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:51.534830 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed23ed-16c5-43d4-b3ba-248adbe0e3d8 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.582110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:51.636390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b497665-f511-407e-ad82-ae7868a7829f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.671176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed23ed-16c5-43d4-b3ba-248adbe0e3d8 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.678006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1095cb-59dc-4575-a8a8-8b41f3667ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.678709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1095cb-59dc-4575-a8a8-8b41f3667ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.679001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1095cb-59dc-4575-a8a8-8b41f3667ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.679284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1095cb-59dc-4575-a8a8-8b41f3667ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.680136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1095cb-59dc-4575-a8a8-8b41f3667ce1 None admin] RBAC: Adding query filter params (group.id=b065d9ac4854407d9b828d595e37ba83, role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=1f0cac840efb41429100d553f9c6d470) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:51.680451 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1095cb-59dc-4575-a8a8-8b41f3667ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:51.681931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1095cb-59dc-4575-a8a8-8b41f3667ce1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:51.688365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 169/346] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/role_assignments?group.id=b065d9ac4854407d9b828d595e37ba83&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:51.689732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2bfa-b69d-4605-813f-0698f57a7d7f None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.689978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2bfa-b69d-4605-813f-0698f57a7d7f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.690264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f2bfa-b69d-4605-813f-0698f57a7d7f None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.691578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 170/347] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:51.692318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f2bfa-b69d-4605-813f-0698f57a7d7f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.711864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08401986-8fff-4dcd-8452-3ac7f8d9cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.712728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08401986-8fff-4dcd-8452-3ac7f8d9cb1e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.713016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08401986-8fff-4dcd-8452-3ac7f8d9cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.713290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08401986-8fff-4dcd-8452-3ac7f8d9cb1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.726174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08401986-8fff-4dcd-8452-3ac7f8d9cb1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-08401986-8fff-4dcd-8452-3ac7f8d9cb1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:51.734245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:51.735246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:51.736024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 178/348] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:51.737454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae2470-62e2-4631-8efe-b3319b93ab19 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.737454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae2470-62e2-4631-8efe-b3319b93ab19 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.737454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae2470-62e2-4631-8efe-b3319b93ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.773451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-87ae2470-62e2-4631-8efe-b3319b93ab19 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:51.775846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-87ae2470-62e2-4631-8efe-b3319b93ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:51.786798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:51.880793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f2bfa-b69d-4605-813f-0698f57a7d7f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:51.925410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcd397-9a03-44ff-aab9-7dc7cd86df17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:51.926169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcd397-9a03-44ff-aab9-7dc7cd86df17 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:51.926477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcd397-9a03-44ff-aab9-7dc7cd86df17 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:51.926760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcd397-9a03-44ff-aab9-7dc7cd86df17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:51.942730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcd397-9a03-44ff-aab9-7dc7cd86df17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-68fcd397-9a03-44ff-aab9-7dc7cd86df17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:51.952512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:51.954042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:51.955510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:51.956127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 179/350] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:51.956197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 171/350] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:51.956270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae2470-62e2-4631-8efe-b3319b93ab19 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.963561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcd397-9a03-44ff-aab9-7dc7cd86df17 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:51.986916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.087633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcd397-9a03-44ff-aab9-7dc7cd86df17 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.090196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae2470-62e2-4631-8efe-b3319b93ab19 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.108578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.130275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015648e-f756-409c-8073-238c9849e1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.131090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015648e-f756-409c-8073-238c9849e1c8 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.131378 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015648e-f756-409c-8073-238c9849e1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.131656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015648e-f756-409c-8073-238c9849e1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.132420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015648e-f756-409c-8073-238c9849e1c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:52.132728 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015648e-f756-409c-8073-238c9849e1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.134619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015648e-f756-409c-8073-238c9849e1c8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.143868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 172/351] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:52.145004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015648e-f756-409c-8073-238c9849e1c8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.156118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e1c5f-44ab-4f79-961a-c634fb90a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.156851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1c5f-44ab-4f79-961a-c634fb90a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.157142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1c5f-44ab-4f79-961a-c634fb90a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.157423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1c5f-44ab-4f79-961a-c634fb90a8c9 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.158186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e1c5f-44ab-4f79-961a-c634fb90a8c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:52.158534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e1c5f-44ab-4f79-961a-c634fb90a8c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.159951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e1c5f-44ab-4f79-961a-c634fb90a8c9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.174063 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 180/352] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:52.175069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e1c5f-44ab-4f79-961a-c634fb90a8c9 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.272067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015648e-f756-409c-8073-238c9849e1c8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.302911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.321027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e1c5f-44ab-4f79-961a-c634fb90a8c9 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.343143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a24f-457e-45db-a1a3-9c0260aa3aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.344014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a24f-457e-45db-a1a3-9c0260aa3aec None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.344305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a24f-457e-45db-a1a3-9c0260aa3aec None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.344581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a24f-457e-45db-a1a3-9c0260aa3aec None admin] PATH_INFO: `/v3/roles/member` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.362761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500d0d9-c365-41f0-ba3a-e3652e93c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.363505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500d0d9-c365-41f0-ba3a-e3652e93c129 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.363792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500d0d9-c365-41f0-ba3a-e3652e93c129 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.364069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500d0d9-c365-41f0-ba3a-e3652e93c129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.368315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309a24f-457e-45db-a1a3-9c0260aa3aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-1309a24f-457e-45db-a1a3-9c0260aa3aec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:52.376892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:52.377848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:52.378685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:52.383733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 173/353] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:52.384390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a24f-457e-45db-a1a3-9c0260aa3aec None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.449764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500d0d9-c365-41f0-ba3a-e3652e93c129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.451268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500d0d9-c365-41f0-ba3a-e3652e93c129 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.458759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.514406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a24f-457e-45db-a1a3-9c0260aa3aec None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.551474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.557194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18cddb-fc40-441a-b54b-4d56bc3940bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.558444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18cddb-fc40-441a-b54b-4d56bc3940bc None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.558733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18cddb-fc40-441a-b54b-4d56bc3940bc None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.559009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18cddb-fc40-441a-b54b-4d56bc3940bc None admin] PATH_INFO: `/v3/users/1251a50cc00040d9ac704265e3254db8` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.560564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18cddb-fc40-441a-b54b-4d56bc3940bc None admin] RBAC: Authorizing `identity:get_user(user_id=1251a50cc00040d9ac704265e3254db8)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.562219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18cddb-fc40-441a-b54b-4d56bc3940bc None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.564725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 174/354] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/users/1251a50cc00040d9ac704265e3254db8 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:52.565649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18cddb-fc40-441a-b54b-4d56bc3940bc None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.575881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 181/355] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:52.577370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec140b35-5999-4d2a-955e-8e592f2a459d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.577668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec140b35-5999-4d2a-955e-8e592f2a459d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.577947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec140b35-5999-4d2a-955e-8e592f2a459d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.580065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 182/356] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:52.580629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec140b35-5999-4d2a-955e-8e592f2a459d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.684218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18cddb-fc40-441a-b54b-4d56bc3940bc None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.686897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.713379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec140b35-5999-4d2a-955e-8e592f2a459d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.728985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc541a-3eaa-4448-ae96-0bc6e16e7728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.730047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc541a-3eaa-4448-ae96-0bc6e16e7728 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.730596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc541a-3eaa-4448-ae96-0bc6e16e7728 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.731200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc541a-3eaa-4448-ae96-0bc6e16e7728 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.732304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc541a-3eaa-4448-ae96-0bc6e16e7728 None admin] RBAC: Adding query filter params (name=member) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:52.732832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc541a-3eaa-4448-ae96-0bc6e16e7728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.734237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc541a-3eaa-4448-ae96-0bc6e16e7728 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.743785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 175/357] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:52.744632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc541a-3eaa-4448-ae96-0bc6e16e7728 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.757668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14c315-e6d7-4232-b6a7-25d520c46324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.758336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14c315-e6d7-4232-b6a7-25d520c46324 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.758667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14c315-e6d7-4232-b6a7-25d520c46324 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.758944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14c315-e6d7-4232-b6a7-25d520c46324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.759782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14c315-e6d7-4232-b6a7-25d520c46324 None admin] RBAC: Adding query filter params (role.id=35aed85335ec44d7b4e694c59769a360, user.id=1251a50cc00040d9ac704265e3254db8, scope.system=all) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:52.760098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14c315-e6d7-4232-b6a7-25d520c46324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.761556 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14c315-e6d7-4232-b6a7-25d520c46324 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.776318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 183/358] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/role_assignments?user.id=1251a50cc00040d9ac704265e3254db8&scope.system=all&role.id=35aed85335ec44d7b4e694c59769a360 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:52.783182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35276b-3bd7-437c-8b37-9a1f875a4017 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.783474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35276b-3bd7-437c-8b37-9a1f875a4017 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.783755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35276b-3bd7-437c-8b37-9a1f875a4017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.810411 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1b35276b-3bd7-437c-8b37-9a1f875a4017 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:52.812204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1b35276b-3bd7-437c-8b37-9a1f875a4017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:52.878625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:52.887387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc541a-3eaa-4448-ae96-0bc6e16e7728 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:52.920688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 184/359] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:52.922852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e221e46-5dae-4e6d-8712-d3030f7368eb None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.922852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e221e46-5dae-4e6d-8712-d3030f7368eb None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.922852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e221e46-5dae-4e6d-8712-d3030f7368eb None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.924243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 185/360] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:52.925017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e221e46-5dae-4e6d-8712-d3030f7368eb None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:52.939337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243d7f7-d810-423d-89ad-a2609a405928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:52.940798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243d7f7-d810-423d-89ad-a2609a405928 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.942588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243d7f7-d810-423d-89ad-a2609a405928 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.943165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243d7f7-d810-423d-89ad-a2609a405928 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.944864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243d7f7-d810-423d-89ad-a2609a405928 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:52.946728 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243d7f7-d810-423d-89ad-a2609a405928 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:52.948849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 176/361] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:52.950541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416fb64-d5f7-47ed-ac3d-e3a0d9206ee6 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:52.951042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416fb64-d5f7-47ed-ac3d-e3a0d9206ee6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:52.951558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416fb64-d5f7-47ed-ac3d-e3a0d9206ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:52.973680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a416fb64-d5f7-47ed-ac3d-e3a0d9206ee6 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:52.975433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a416fb64-d5f7-47ed-ac3d-e3a0d9206ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:53.017056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.077213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 177/362] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:53.078342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416fb64-d5f7-47ed-ac3d-e3a0d9206ee6 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.078555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e221e46-5dae-4e6d-8712-d3030f7368eb None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.125147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843a70d-fecf-4bf9-9fef-047df15e87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.125878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843a70d-fecf-4bf9-9fef-047df15e87a5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.126285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843a70d-fecf-4bf9-9fef-047df15e87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.126676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843a70d-fecf-4bf9-9fef-047df15e87a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.178775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.205755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416fb64-d5f7-47ed-ac3d-e3a0d9206ee6 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.211277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843a70d-fecf-4bf9-9fef-047df15e87a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:53.212831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843a70d-fecf-4bf9-9fef-047df15e87a5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:53.253125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d5b41-49c9-49fe-be35-819c1058c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.253990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d5b41-49c9-49fe-be35-819c1058c76b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.254272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d5b41-49c9-49fe-be35-819c1058c76b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.254603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d5b41-49c9-49fe-be35-819c1058c76b None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.255806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d5b41-49c9-49fe-be35-819c1058c76b None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:53.257274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d5b41-49c9-49fe-be35-819c1058c76b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:53.260261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 178/363] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:53.261802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d5b41-49c9-49fe-be35-819c1058c76b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.303740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.358171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 186/364] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:53.359704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843a70d-fecf-4bf9-9fef-047df15e87a5 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.410556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d5b41-49c9-49fe-be35-819c1058c76b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.452357 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.459879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa09259-f06b-454f-99bf-234b5b1608f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.460699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa09259-f06b-454f-99bf-234b5b1608f1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.460985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa09259-f06b-454f-99bf-234b5b1608f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.461260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa09259-f06b-454f-99bf-234b5b1608f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.478335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa09259-f06b-454f-99bf-234b5b1608f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-6aa09259-f06b-454f-99bf-234b5b1608f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:53.487526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:53.488531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 179/365] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:53.489381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa09259-f06b-454f-99bf-234b5b1608f1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.511179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843a70d-fecf-4bf9-9fef-047df15e87a5 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.554089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedc439-f8ba-489a-a3fd-7ac68d0fe32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.555227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedc439-f8ba-489a-a3fd-7ac68d0fe32c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.555656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedc439-f8ba-489a-a3fd-7ac68d0fe32c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.556083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedc439-f8ba-489a-a3fd-7ac68d0fe32c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.575629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedc439-f8ba-489a-a3fd-7ac68d0fe32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-1bedc439-f8ba-489a-a3fd-7ac68d0fe32c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:53.586361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:53.587339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:53.588137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 187/366] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:53.589652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedc439-f8ba-489a-a3fd-7ac68d0fe32c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.602680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.615525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa09259-f06b-454f-99bf-234b5b1608f1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.667113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06fc4-2a76-4730-873a-d6a47f7ff513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.667787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06fc4-2a76-4730-873a-d6a47f7ff513 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.668137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06fc4-2a76-4730-873a-d6a47f7ff513 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.668424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e06fc4-2a76-4730-873a-d6a47f7ff513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.669272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e06fc4-2a76-4730-873a-d6a47f7ff513 None admin] RBAC: Adding query filter params (group.id=b065d9ac4854407d9b828d595e37ba83, role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=1f0cac840efb41429100d553f9c6d470) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:53.669597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e06fc4-2a76-4730-873a-d6a47f7ff513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:53.671643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e06fc4-2a76-4730-873a-d6a47f7ff513 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:53.678667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 180/367] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/role_assignments?group.id=b065d9ac4854407d9b828d595e37ba83&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:53.682095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06fc4-2a76-4730-873a-d6a47f7ff513 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.749873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedc439-f8ba-489a-a3fd-7ac68d0fe32c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.805238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c214b7-1323-4f91-b062-5e45522ebd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.806355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c214b7-1323-4f91-b062-5e45522ebd5f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.806788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c214b7-1323-4f91-b062-5e45522ebd5f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.807070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c214b7-1323-4f91-b062-5e45522ebd5f None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.809127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c214b7-1323-4f91-b062-5e45522ebd5f None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:53.811663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c214b7-1323-4f91-b062-5e45522ebd5f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:53.814452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 188/368] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:53.815277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c214b7-1323-4f91-b062-5e45522ebd5f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.823913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.856893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e06fc4-2a76-4730-873a-d6a47f7ff513 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.904303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddeffc-c8b4-4519-9fb6-a7f6c1a93a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:53.904904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddeffc-c8b4-4519-9fb6-a7f6c1a93a36 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:53.905293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddeffc-c8b4-4519-9fb6-a7f6c1a93a36 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:53.905573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddeffc-c8b4-4519-9fb6-a7f6c1a93a36 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:53.906479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddeffc-c8b4-4519-9fb6-a7f6c1a93a36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:53.906831 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddeffc-c8b4-4519-9fb6-a7f6c1a93a36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:53.908239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddeffc-c8b4-4519-9fb6-a7f6c1a93a36 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:53.919304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 181/369] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:53.920154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddeffc-c8b4-4519-9fb6-a7f6c1a93a36 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:53.946302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:53.958810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c214b7-1323-4f91-b062-5e45522ebd5f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:53.999267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8de30-bb59-49a3-af7f-f1d2765ff143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.000082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8de30-bb59-49a3-af7f-f1d2765ff143 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.000491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8de30-bb59-49a3-af7f-f1d2765ff143 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.000758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8de30-bb59-49a3-af7f-f1d2765ff143 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.001540 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8de30-bb59-49a3-af7f-f1d2765ff143 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:54.001856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8de30-bb59-49a3-af7f-f1d2765ff143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.003467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8de30-bb59-49a3-af7f-f1d2765ff143 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.013837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 189/370] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:54.014830 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8de30-bb59-49a3-af7f-f1d2765ff143 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.045640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddeffc-c8b4-4519-9fb6-a7f6c1a93a36 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.086486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.090911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8688b3-d3e0-4edd-9ed3-f7b17f6d3716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.092141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8688b3-d3e0-4edd-9ed3-f7b17f6d3716 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.092643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8688b3-d3e0-4edd-9ed3-f7b17f6d3716 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.093287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8688b3-d3e0-4edd-9ed3-f7b17f6d3716 None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.095783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8688b3-d3e0-4edd-9ed3-f7b17f6d3716 None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.097576 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8688b3-d3e0-4edd-9ed3-f7b17f6d3716 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.099928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 182/371] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:53 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:54.101053 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8688b3-d3e0-4edd-9ed3-f7b17f6d3716 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.142231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8de30-bb59-49a3-af7f-f1d2765ff143 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.205235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b57dd-c42c-4479-9192-b1507503f3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.205921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b57dd-c42c-4479-9192-b1507503f3df None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.206230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b57dd-c42c-4479-9192-b1507503f3df None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.206538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b57dd-c42c-4479-9192-b1507503f3df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.226475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.252407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8688b3-d3e0-4edd-9ed3-f7b17f6d3716 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.289695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b57dd-c42c-4479-9192-b1507503f3df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.291744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b57dd-c42c-4479-9192-b1507503f3df None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.293541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b54130-6faa-4bb2-9918-4abf70fab8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.294198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b54130-6faa-4bb2-9918-4abf70fab8bb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.294527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b54130-6faa-4bb2-9918-4abf70fab8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.294805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b54130-6faa-4bb2-9918-4abf70fab8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.358785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.378259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b54130-6faa-4bb2-9918-4abf70fab8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.379854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b54130-6faa-4bb2-9918-4abf70fab8bb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.404634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 190/372] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:54.405630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b57dd-c42c-4479-9192-b1507503f3df None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.507017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.512560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 183/373] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:54.513833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b54130-6faa-4bb2-9918-4abf70fab8bb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.550787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b57dd-c42c-4479-9192-b1507503f3df None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.605004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11e6e2-43db-4a49-b98e-31f21673539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.605676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11e6e2-43db-4a49-b98e-31f21673539c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.605865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11e6e2-43db-4a49-b98e-31f21673539c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.606091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11e6e2-43db-4a49-b98e-31f21673539c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.606982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11e6e2-43db-4a49-b98e-31f21673539c None admin] RBAC: Adding query filter params (group.id=b065d9ac4854407d9b828d595e37ba83, role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:54.607405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11e6e2-43db-4a49-b98e-31f21673539c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.608732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11e6e2-43db-4a49-b98e-31f21673539c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.615831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 191/374] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/role_assignments?group.id=b065d9ac4854407d9b828d595e37ba83&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:54.617315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246d1a-adcc-468f-8c49-170e271981a8 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.617600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246d1a-adcc-468f-8c49-170e271981a8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.617876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246d1a-adcc-468f-8c49-170e271981a8 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.622406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 192/375] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:54.622406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246d1a-adcc-468f-8c49-170e271981a8 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.660470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b54130-6faa-4bb2-9918-4abf70fab8bb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.661261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.706275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80960-38ff-4e93-90f3-52ddd000eeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.707493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80960-38ff-4e93-90f3-52ddd000eeea None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.707822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80960-38ff-4e93-90f3-52ddd000eeea None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.708253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80960-38ff-4e93-90f3-52ddd000eeea None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.709434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d80960-38ff-4e93-90f3-52ddd000eeea None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.710982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d80960-38ff-4e93-90f3-52ddd000eeea None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.713021 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 184/376] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:54.714265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb781d-0284-489d-b54c-91e6ad64b605 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.714576 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb781d-0284-489d-b54c-91e6ad64b605 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.714852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb781d-0284-489d-b54c-91e6ad64b605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.734447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f3eb781d-0284-489d-b54c-91e6ad64b605 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:54.736366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f3eb781d-0284-489d-b54c-91e6ad64b605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:54.765175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246d1a-adcc-468f-8c49-170e271981a8 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.800441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.805679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95302-bd86-4581-a872-84c824e005c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:54.806822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95302-bd86-4581-a872-84c824e005c3 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:54.810020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95302-bd86-4581-a872-84c824e005c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:54.810020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95302-bd86-4581-a872-84c824e005c3 None admin] PATH_INFO: `/v3/projects/9b921b8affc14177a85b3aac3f02deca` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:54.810020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b95302-bd86-4581-a872-84c824e005c3 None admin] RBAC: Authorizing `identity:get_project(project_id=9b921b8affc14177a85b3aac3f02deca)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:54.811064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b95302-bd86-4581-a872-84c824e005c3 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:54.814495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 193/377] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/projects/9b921b8affc14177a85b3aac3f02deca => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:54.815614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95302-bd86-4581-a872-84c824e005c3 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.820280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 185/378] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:54.821220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb781d-0284-489d-b54c-91e6ad64b605 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:54.961096 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:54.968445 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb781d-0284-489d-b54c-91e6ad64b605 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:54.968640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95302-bd86-4581-a872-84c824e005c3 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.015369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d8db-002b-43f6-9892-9dc3e144aaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.016287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d8db-002b-43f6-9892-9dc3e144aaa3 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.016570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d8db-002b-43f6-9892-9dc3e144aaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.016927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d8db-002b-43f6-9892-9dc3e144aaa3 None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.017610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abb732-cae6-42c5-9901-932853654364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.018123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047d8db-002b-43f6-9892-9dc3e144aaa3 None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.018508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abb732-cae6-42c5-9901-932853654364 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.018797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abb732-cae6-42c5-9901-932853654364 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.019076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abb732-cae6-42c5-9901-932853654364 None admin] PATH_INFO: `/v3/groups/cb6c3432131548809068e6d3a1c7da76` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.019720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047d8db-002b-43f6-9892-9dc3e144aaa3 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.021457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 194/379] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.022232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d8db-002b-43f6-9892-9dc3e144aaa3 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.025060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abb732-cae6-42c5-9901-932853654364 None admin] RBAC: Authorizing `identity:get_group(group_id=cb6c3432131548809068e6d3a1c7da76)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.026603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abb732-cae6-42c5-9901-932853654364 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.028432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 186/380] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:54 2022] GET /identity/v3/groups/cb6c3432131548809068e6d3a1c7da76 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.029211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abb732-cae6-42c5-9901-932853654364 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.090900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:55.138263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d8db-002b-43f6-9892-9dc3e144aaa3 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.146785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abb732-cae6-42c5-9901-932853654364 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.177114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98c63d-67fd-4148-8a17-4f106c8bb4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.177919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98c63d-67fd-4148-8a17-4f106c8bb4a7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.178205 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98c63d-67fd-4148-8a17-4f106c8bb4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.178513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98c63d-67fd-4148-8a17-4f106c8bb4a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.186333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3bc10-2c55-4816-a20f-b6fef640d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.187055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3bc10-2c55-4816-a20f-b6fef640d548 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.187349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3bc10-2c55-4816-a20f-b6fef640d548 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.187633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3bc10-2c55-4816-a20f-b6fef640d548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.188531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3bc10-2c55-4816-a20f-b6fef640d548 None admin] RBAC: Adding query filter params (group.id=b065d9ac4854407d9b828d595e37ba83, role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:55.188855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3bc10-2c55-4816-a20f-b6fef640d548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.190351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3bc10-2c55-4816-a20f-b6fef640d548 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.191461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98c63d-67fd-4148-8a17-4f106c8bb4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:55.196991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 187/381] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/role_assignments?group.id=b065d9ac4854407d9b828d595e37ba83&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.197892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3bc10-2c55-4816-a20f-b6fef640d548 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-1d98c63d-67fd-4148-8a17-4f106c8bb4a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:55.199348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:55.200200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:55.200990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 195/382] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:55.207358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98c63d-67fd-4148-8a17-4f106c8bb4a7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.252931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:55.340753 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3bc10-2c55-4816-a20f-b6fef640d548 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.346449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98c63d-67fd-4148-8a17-4f106c8bb4a7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.366817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:55.383531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0e01c-0a10-430d-934f-b085b4f42b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.384210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0e01c-0a10-430d-934f-b085b4f42b18 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.384503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0e01c-0a10-430d-934f-b085b4f42b18 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.384788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0e01c-0a10-430d-934f-b085b4f42b18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.385747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0e01c-0a10-430d-934f-b085b4f42b18 None admin] RBAC: Adding query filter params (group.id=cb6c3432131548809068e6d3a1c7da76, role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=9b921b8affc14177a85b3aac3f02deca) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:55.386004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b6e79-cc17-45ee-ac0f-fab5bedbc5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.386142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0e01c-0a10-430d-934f-b085b4f42b18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.387627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0e01c-0a10-430d-934f-b085b4f42b18 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.388454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b6e79-cc17-45ee-ac0f-fab5bedbc5d6 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.388924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b6e79-cc17-45ee-ac0f-fab5bedbc5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.389375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b6e79-cc17-45ee-ac0f-fab5bedbc5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.390608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b6e79-cc17-45ee-ac0f-fab5bedbc5d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:55.391107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b6e79-cc17-45ee-ac0f-fab5bedbc5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.393242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b6e79-cc17-45ee-ac0f-fab5bedbc5d6 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.394739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 188/383] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/role_assignments?group.id=cb6c3432131548809068e6d3a1c7da76&scope.project.id=9b921b8affc14177a85b3aac3f02deca&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.404018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 196/384] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.410425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0e01c-0a10-430d-934f-b085b4f42b18 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.546170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0e01c-0a10-430d-934f-b085b4f42b18 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.588064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28134563-5262-4f47-831b-2c86121412f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.588972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28134563-5262-4f47-831b-2c86121412f1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.589248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28134563-5262-4f47-831b-2c86121412f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.589526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28134563-5262-4f47-831b-2c86121412f1 None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.590947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28134563-5262-4f47-831b-2c86121412f1 None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.592397 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28134563-5262-4f47-831b-2c86121412f1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.594499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 189/385] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.600242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b6e79-cc17-45ee-ac0f-fab5bedbc5d6 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.703306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:55.721660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b6e79-cc17-45ee-ac0f-fab5bedbc5d6 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.758718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929c498-cb54-4e60-898a-2e91821c1831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.759683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929c498-cb54-4e60-898a-2e91821c1831 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.759966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929c498-cb54-4e60-898a-2e91821c1831 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.760239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929c498-cb54-4e60-898a-2e91821c1831 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.761456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929c498-cb54-4e60-898a-2e91821c1831 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.762965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929c498-cb54-4e60-898a-2e91821c1831 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.765052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 197/386] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:55 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:55.771223 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28134563-5262-4f47-831b-2c86121412f1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:55.838109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:55.913500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28134563-5262-4f47-831b-2c86121412f1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:55.955989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b273178-06cd-4ebc-90e1-9dc3b2717807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:55.957133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b273178-06cd-4ebc-90e1-9dc3b2717807 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:55.957750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b273178-06cd-4ebc-90e1-9dc3b2717807 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:55.958264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b273178-06cd-4ebc-90e1-9dc3b2717807 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470/groups/b065d9ac4854407d9b828d595e37ba83/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:55.960522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b273178-06cd-4ebc-90e1-9dc3b2717807 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f0cac840efb41429100d553f9c6d470, group_id=b065d9ac4854407d9b828d595e37ba83, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:55.962129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b273178-06cd-4ebc-90e1-9dc3b2717807 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:55.982525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 190/387] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jun 16 18:36:55 2022] PUT /identity/v3/projects/1f0cac840efb41429100d553f9c6d470/groups/b065d9ac4854407d9b828d595e37ba83/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:56.391846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932101e5-9c74-4884-b26a-f084935e077c None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.392749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932101e5-9c74-4884-b26a-f084935e077c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.393182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932101e5-9c74-4884-b26a-f084935e077c None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.395031 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 198/388] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:56.404214 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330cca7-1303-4d2f-ba9d-fbd26f6324c2 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.405114 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330cca7-1303-4d2f-ba9d-fbd26f6324c2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.405631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330cca7-1303-4d2f-ba9d-fbd26f6324c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.424412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-4330cca7-1303-4d2f-ba9d-fbd26f6324c2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:56.425946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4330cca7-1303-4d2f-ba9d-fbd26f6324c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:56.500540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 191/389] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:56.534426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932101e5-9c74-4884-b26a-f084935e077c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.651906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932101e5-9c74-4884-b26a-f084935e077c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.689823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68179e6b-2f34-48da-bcb5-4654fd1bdd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.691031 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68179e6b-2f34-48da-bcb5-4654fd1bdd21 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.691559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68179e6b-2f34-48da-bcb5-4654fd1bdd21 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.692048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68179e6b-2f34-48da-bcb5-4654fd1bdd21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.704390 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68179e6b-2f34-48da-bcb5-4654fd1bdd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-68179e6b-2f34-48da-bcb5-4654fd1bdd21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:56.713324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:56.714258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:56.715062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:56.717745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 199/390] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:56.724651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330cca7-1303-4d2f-ba9d-fbd26f6324c2 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.767166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:56.837932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330cca7-1303-4d2f-ba9d-fbd26f6324c2 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:56.875026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf596b-23ed-446f-95a4-abb32ac46ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:56.876666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf596b-23ed-446f-95a4-abb32ac46ff1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:56.877163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf596b-23ed-446f-95a4-abb32ac46ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:56.877666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf596b-23ed-446f-95a4-abb32ac46ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:56.878676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf596b-23ed-446f-95a4-abb32ac46ff1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:56.879190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf596b-23ed-446f-95a4-abb32ac46ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:56.880906 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf596b-23ed-446f-95a4-abb32ac46ff1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:56.890822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 192/391] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:56.897244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68179e6b-2f34-48da-bcb5-4654fd1bdd21 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:56.916350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.029729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68179e6b-2f34-48da-bcb5-4654fd1bdd21 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.076660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71376c-b2e0-4682-bb93-9fd99ca3a19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.077938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71376c-b2e0-4682-bb93-9fd99ca3a19b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.078508 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71376c-b2e0-4682-bb93-9fd99ca3a19b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.079016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71376c-b2e0-4682-bb93-9fd99ca3a19b None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.080415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71376c-b2e0-4682-bb93-9fd99ca3a19b None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:57.082090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71376c-b2e0-4682-bb93-9fd99ca3a19b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:57.084039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 200/392] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:56 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:57.089735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf596b-23ed-446f-95a4-abb32ac46ff1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:57.215390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.225271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf596b-23ed-446f-95a4-abb32ac46ff1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.249380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e840c-3bf8-4f2f-a35d-b237c2da834a None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.249680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e840c-3bf8-4f2f-a35d-b237c2da834a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.249951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e840c-3bf8-4f2f-a35d-b237c2da834a None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.252108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 201/393] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:36:57.277131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd736a9e-bd8a-4050-8a9d-3377e7de10e6 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.277802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd736a9e-bd8a-4050-8a9d-3377e7de10e6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.278276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd736a9e-bd8a-4050-8a9d-3377e7de10e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.280973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf6bec-5a5a-4a2f-9ace-131e2dc7e144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.282140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf6bec-5a5a-4a2f-9ace-131e2dc7e144 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.282705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf6bec-5a5a-4a2f-9ace-131e2dc7e144 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.283193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf6bec-5a5a-4a2f-9ace-131e2dc7e144 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.284839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf6bec-5a5a-4a2f-9ace-131e2dc7e144 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:57.286525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf6bec-5a5a-4a2f-9ace-131e2dc7e144 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:57.288536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 193/394] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:57 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:57.299843 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf6bec-5a5a-4a2f-9ace-131e2dc7e144 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:57.311585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-dd736a9e-bd8a-4050-8a9d-3377e7de10e6 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:57.313110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dd736a9e-bd8a-4050-8a9d-3377e7de10e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:57.412770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf6bec-5a5a-4a2f-9ace-131e2dc7e144 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.452207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf6052-fff2-4851-8f7a-cc3c44ff3cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.453564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf6052-fff2-4851-8f7a-cc3c44ff3cd9 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.454079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf6052-fff2-4851-8f7a-cc3c44ff3cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.454588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf6052-fff2-4851-8f7a-cc3c44ff3cd9 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470/groups/b065d9ac4854407d9b828d595e37ba83/roles/85059d55a9ee403aa18b9580d26ccbed` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.457317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf6052-fff2-4851-8f7a-cc3c44ff3cd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f0cac840efb41429100d553f9c6d470, group_id=b065d9ac4854407d9b828d595e37ba83, role_id=85059d55a9ee403aa18b9580d26ccbed)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:57.459120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf6052-fff2-4851-8f7a-cc3c44ff3cd9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:57.464633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 202/395] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:57.488651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd736a9e-bd8a-4050-8a9d-3377e7de10e6 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:57.494565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 194/396] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jun 16 18:36:57 2022] PUT /identity/v3/projects/1f0cac840efb41429100d553f9c6d470/groups/b065d9ac4854407d9b828d595e37ba83/roles/85059d55a9ee403aa18b9580d26ccbed => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:57.513748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.664458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd736a9e-bd8a-4050-8a9d-3377e7de10e6 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.714931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff49bf-29cc-42b9-881d-6d85dce26874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.716122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff49bf-29cc-42b9-881d-6d85dce26874 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.716602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff49bf-29cc-42b9-881d-6d85dce26874 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.717088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff49bf-29cc-42b9-881d-6d85dce26874 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.736083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff49bf-29cc-42b9-881d-6d85dce26874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-9eff49bf-29cc-42b9-881d-6d85dce26874 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:57.744146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:57.745082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:57.745870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 203/397] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:57.751920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf6052-fff2-4851-8f7a-cc3c44ff3cd9 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:57.798376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.881924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf6052-fff2-4851-8f7a-cc3c44ff3cd9 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:57.926140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e245d4-6013-4529-8c42-67e23ecf4e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:57.926859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e245d4-6013-4529-8c42-67e23ecf4e7b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:57.927148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e245d4-6013-4529-8c42-67e23ecf4e7b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:57.927431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e245d4-6013-4529-8c42-67e23ecf4e7b None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:57.928199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e245d4-6013-4529-8c42-67e23ecf4e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:57.928510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e245d4-6013-4529-8c42-67e23ecf4e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:57.929918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e245d4-6013-4529-8c42-67e23ecf4e7b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:57.939632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 195/398] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:57.945152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff49bf-29cc-42b9-881d-6d85dce26874 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.071937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:58.119395 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff49bf-29cc-42b9-881d-6d85dce26874 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:58.150701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b96bc-4dd7-4009-bcfe-54e15640ddd8 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.151112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b96bc-4dd7-4009-bcfe-54e15640ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.151401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b96bc-4dd7-4009-bcfe-54e15640ddd8 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.153346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 196/399] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:58.159050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a4a6-c538-471b-8679-b44fa5ab0fd4 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.159440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a4a6-c538-471b-8679-b44fa5ab0fd4 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.159622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63a4a6-c538-471b-8679-b44fa5ab0fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.160087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb040be5-31fe-4e9a-a7a1-a8f043d5b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:58.160947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb040be5-31fe-4e9a-a7a1-a8f043d5b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.161227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb040be5-31fe-4e9a-a7a1-a8f043d5b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.161501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb040be5-31fe-4e9a-a7a1-a8f043d5b9d2 None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.162777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb040be5-31fe-4e9a-a7a1-a8f043d5b9d2 None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:58.164274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb040be5-31fe-4e9a-a7a1-a8f043d5b9d2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:58.166252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 204/400] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:57 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:58.172649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb040be5-31fe-4e9a-a7a1-a8f043d5b9d2 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.188412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ed63a4a6-c538-471b-8679-b44fa5ab0fd4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:58.189641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ed63a4a6-c538-471b-8679-b44fa5ab0fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:58.290271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 197/401] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:36:58.312902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63a4a6-c538-471b-8679-b44fa5ab0fd4 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.332483 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:58.360858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb040be5-31fe-4e9a-a7a1-a8f043d5b9d2 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:58.434314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63a4a6-c538-471b-8679-b44fa5ab0fd4 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:58.472520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04574b8a-1594-4719-b4cd-a902ddea4dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:58.473399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04574b8a-1594-4719-b4cd-a902ddea4dfc None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.473683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04574b8a-1594-4719-b4cd-a902ddea4dfc None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.473957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04574b8a-1594-4719-b4cd-a902ddea4dfc None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.477257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1310cd8-0fa7-4c94-a15d-3cd4a711717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:58.478066 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1310cd8-0fa7-4c94-a15d-3cd4a711717a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.478347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1310cd8-0fa7-4c94-a15d-3cd4a711717a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.478649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1310cd8-0fa7-4c94-a15d-3cd4a711717a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.479042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04574b8a-1594-4719-b4cd-a902ddea4dfc None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:58.480512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04574b8a-1594-4719-b4cd-a902ddea4dfc None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:58.482633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 205/402] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:58 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:58.491159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1310cd8-0fa7-4c94-a15d-3cd4a711717a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:58.491326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04574b8a-1594-4719-b4cd-a902ddea4dfc None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-d1310cd8-0fa7-4c94-a15d-3cd4a711717a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:58.512490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:58.513424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:36:58.514210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 198/403] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:58.520030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1310cd8-0fa7-4c94-a15d-3cd4a711717a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.528656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:58.637815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04574b8a-1594-4719-b4cd-a902ddea4dfc None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:58.638499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:58.650846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1310cd8-0fa7-4c94-a15d-3cd4a711717a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:58.687047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2e5f1-f816-43ef-a370-a2c66ed33f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:58.688313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e5f1-f816-43ef-a370-a2c66ed33f24 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.688607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e5f1-f816-43ef-a370-a2c66ed33f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.688885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2e5f1-f816-43ef-a370-a2c66ed33f24 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/groups/b065d9ac4854407d9b828d595e37ba83/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.691380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2e5f1-f816-43ef-a370-a2c66ed33f24 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8cc7688c6d046abad0e3ebd04723c92, group_id=b065d9ac4854407d9b828d595e37ba83, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:58.693438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2e5f1-f816-43ef-a370-a2c66ed33f24 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:58.701922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42929d-7a55-4e1e-a5fb-7a6107a5ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:58.703065 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42929d-7a55-4e1e-a5fb-7a6107a5ba51 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.703557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42929d-7a55-4e1e-a5fb-7a6107a5ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.704071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42929d-7a55-4e1e-a5fb-7a6107a5ba51 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.705262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42929d-7a55-4e1e-a5fb-7a6107a5ba51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:58.705850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42929d-7a55-4e1e-a5fb-7a6107a5ba51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:58.707501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42929d-7a55-4e1e-a5fb-7a6107a5ba51 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:58.722423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 206/404] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jun 16 18:36:58 2022] PUT /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/groups/b065d9ac4854407d9b828d595e37ba83/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:36:58.722423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a120e2-6fb6-4201-8f56-6eb197b5025d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.722423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a120e2-6fb6-4201-8f56-6eb197b5025d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.722423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a120e2-6fb6-4201-8f56-6eb197b5025d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.723175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 207/405] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:58.724346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 199/406] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:36:58.732070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42929d-7a55-4e1e-a5fb-7a6107a5ba51 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.732363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4cd60-13cf-4d38-bbf4-84e4c2a09a5d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.732736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4cd60-13cf-4d38-bbf4-84e4c2a09a5d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.733195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4cd60-13cf-4d38-bbf4-84e4c2a09a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.783796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-99f4cd60-13cf-4d38-bbf4-84e4c2a09a5d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:58.785022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-99f4cd60-13cf-4d38-bbf4-84e4c2a09a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:58.882266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:58.897221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42929d-7a55-4e1e-a5fb-7a6107a5ba51 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:58.904679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 208/407] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:58.947340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4cd60-13cf-4d38-bbf4-84e4c2a09a5d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.952677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5df4-a3ae-43c8-8406-ada79fab4e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:58.953550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5df4-a3ae-43c8-8406-ada79fab4e14 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:58.953829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5df4-a3ae-43c8-8406-ada79fab4e14 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:58.954655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5df4-a3ae-43c8-8406-ada79fab4e14 None admin] PATH_INFO: `/v3/groups/cb6c3432131548809068e6d3a1c7da76` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:58.956553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a5df4-a3ae-43c8-8406-ada79fab4e14 None admin] RBAC: Authorizing `identity:get_group(group_id=cb6c3432131548809068e6d3a1c7da76)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:58.958324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a5df4-a3ae-43c8-8406-ada79fab4e14 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:58.960611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 200/408] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:58 2022] GET /identity/v3/groups/cb6c3432131548809068e6d3a1c7da76 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:58.966253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5df4-a3ae-43c8-8406-ada79fab4e14 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:58.991515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.073554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4cd60-13cf-4d38-bbf4-84e4c2a09a5d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.090834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5df4-a3ae-43c8-8406-ada79fab4e14 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.119301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a13b75-64ab-492d-ba9e-ce943db70140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.120276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a13b75-64ab-492d-ba9e-ce943db70140 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.120563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a13b75-64ab-492d-ba9e-ce943db70140 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.121159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a13b75-64ab-492d-ba9e-ce943db70140 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.129166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f695-5600-418d-9998-75196ae4e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.130151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f695-5600-418d-9998-75196ae4e81b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.130592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f695-5600-418d-9998-75196ae4e81b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.130871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f695-5600-418d-9998-75196ae4e81b None admin] PATH_INFO: `/v3/projects/9b921b8affc14177a85b3aac3f02deca` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.132115 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300f695-5600-418d-9998-75196ae4e81b None admin] RBAC: Authorizing `identity:get_project(project_id=9b921b8affc14177a85b3aac3f02deca)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.133571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300f695-5600-418d-9998-75196ae4e81b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.133682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a13b75-64ab-492d-ba9e-ce943db70140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:59.135625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 201/409] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:58 2022] GET /identity/v3/projects/9b921b8affc14177a85b3aac3f02deca => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-f8a13b75-64ab-492d-ba9e-ce943db70140 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:59.142418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:59.143302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:59.144109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 209/410] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:36:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:36:59.144785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f695-5600-418d-9998-75196ae4e81b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.156366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a13b75-64ab-492d-ba9e-ce943db70140 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.284482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.304071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f695-5600-418d-9998-75196ae4e81b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.328286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a13b75-64ab-492d-ba9e-ce943db70140 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.342212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807cb45-50b8-4fca-aed7-37f3789e7984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.343254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807cb45-50b8-4fca-aed7-37f3789e7984 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.343542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807cb45-50b8-4fca-aed7-37f3789e7984 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.343945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807cb45-50b8-4fca-aed7-37f3789e7984 None admin] PATH_INFO: `/v3/projects/9b921b8affc14177a85b3aac3f02deca/groups/cb6c3432131548809068e6d3a1c7da76/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.345997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807cb45-50b8-4fca-aed7-37f3789e7984 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b921b8affc14177a85b3aac3f02deca, group_id=cb6c3432131548809068e6d3a1c7da76, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.346517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.355359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807cb45-50b8-4fca-aed7-37f3789e7984 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.369769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc704f-2bd2-426f-8ddf-43f70b928ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.370471 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc704f-2bd2-426f-8ddf-43f70b928ec1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.370754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc704f-2bd2-426f-8ddf-43f70b928ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.371028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc704f-2bd2-426f-8ddf-43f70b928ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.371783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc704f-2bd2-426f-8ddf-43f70b928ec1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:36:59.372094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc704f-2bd2-426f-8ddf-43f70b928ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.373590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc704f-2bd2-426f-8ddf-43f70b928ec1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.382430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 202/411] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jun 16 18:36:59 2022] PUT /identity/v3/projects/9b921b8affc14177a85b3aac3f02deca/groups/cb6c3432131548809068e6d3a1c7da76/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:36:59.385325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0bbb8-ac39-404e-bdbc-ef2733a67ed1 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.385783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0bbb8-ac39-404e-bdbc-ef2733a67ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.386360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0bbb8-ac39-404e-bdbc-ef2733a67ed1 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.388090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 203/412] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:36:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:36:59.390552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 210/413] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:59.394845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc793-7338-427e-9a97-98955e26f36e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.395411 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc793-7338-427e-9a97-98955e26f36e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.396492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0bbb8-ac39-404e-bdbc-ef2733a67ed1 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.397847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc793-7338-427e-9a97-98955e26f36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.432620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-9bafc793-7338-427e-9a97-98955e26f36e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:36:59.435642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9bafc793-7338-427e-9a97-98955e26f36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:36:59.594412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 211/414] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:36:59.616285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0bbb8-ac39-404e-bdbc-ef2733a67ed1 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.623899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc793-7338-427e-9a97-98955e26f36e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.669839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5015c9b-a8d7-4faa-bae7-b79cab14a7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.672231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5015c9b-a8d7-4faa-bae7-b79cab14a7e7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.672733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5015c9b-a8d7-4faa-bae7-b79cab14a7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.673805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5015c9b-a8d7-4faa-bae7-b79cab14a7e7 None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.679218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5015c9b-a8d7-4faa-bae7-b79cab14a7e7 None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.682836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5015c9b-a8d7-4faa-bae7-b79cab14a7e7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.689291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 204/415] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:59.699893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5015c9b-a8d7-4faa-bae7-b79cab14a7e7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.700857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.705017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:59.760265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc793-7338-427e-9a97-98955e26f36e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.814956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc23090-06ad-434d-95e3-cc47ac190d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.816003 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc23090-06ad-434d-95e3-cc47ac190d18 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.822870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc23090-06ad-434d-95e3-cc47ac190d18 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.823233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc23090-06ad-434d-95e3-cc47ac190d18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.855456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc23090-06ad-434d-95e3-cc47ac190d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-6cc23090-06ad-434d-95e3-cc47ac190d18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:36:59.864065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:36:59.865182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:36:59.866148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:36:59.868233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 212/416] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:36:59.873861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc23090-06ad-434d-95e3-cc47ac190d18 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:36:59.891503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5015c9b-a8d7-4faa-bae7-b79cab14a7e7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:36:59.929690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145d418-d114-449e-abdf-957c374928df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:36:59.930745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145d418-d114-449e-abdf-957c374928df None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:36:59.931138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145d418-d114-449e-abdf-957c374928df None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:36:59.931530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145d418-d114-449e-abdf-957c374928df None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:36:59.932950 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145d418-d114-449e-abdf-957c374928df None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:36:59.934756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145d418-d114-449e-abdf-957c374928df None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:36:59.936928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 205/417] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:36:59.944697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145d418-d114-449e-abdf-957c374928df None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.015371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc23090-06ad-434d-95e3-cc47ac190d18 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.027679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.065449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37347c8d-febd-4f4c-953d-840deb071cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.066165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37347c8d-febd-4f4c-953d-840deb071cc5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.066480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37347c8d-febd-4f4c-953d-840deb071cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.066757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37347c8d-febd-4f4c-953d-840deb071cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.067549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37347c8d-febd-4f4c-953d-840deb071cc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:00.067855 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37347c8d-febd-4f4c-953d-840deb071cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.069457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37347c8d-febd-4f4c-953d-840deb071cc5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.092376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 213/418] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:36:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:00.098894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37347c8d-febd-4f4c-953d-840deb071cc5 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.103988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.140861 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145d418-d114-449e-abdf-957c374928df None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.177262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe20645-8ad1-4fa8-87c2-a2456c6ebbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.178527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20645-8ad1-4fa8-87c2-a2456c6ebbcc None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.179036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20645-8ad1-4fa8-87c2-a2456c6ebbcc None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.179525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20645-8ad1-4fa8-87c2-a2456c6ebbcc None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/groups/b065d9ac4854407d9b828d595e37ba83/roles/85059d55a9ee403aa18b9580d26ccbed` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.182046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe20645-8ad1-4fa8-87c2-a2456c6ebbcc None admin] RBAC: Authorizing `identity:create_grant(project_id=e8cc7688c6d046abad0e3ebd04723c92, group_id=b065d9ac4854407d9b828d595e37ba83, role_id=85059d55a9ee403aa18b9580d26ccbed)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.184067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe20645-8ad1-4fa8-87c2-a2456c6ebbcc None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.201320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 206/419] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jun 16 18:36:59 2022] PUT /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92/groups/b065d9ac4854407d9b828d595e37ba83/roles/85059d55a9ee403aa18b9580d26ccbed => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:00.203304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a54a-6bfd-4d7c-adfa-d6ff4e6d2f1a None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.203971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a54a-6bfd-4d7c-adfa-d6ff4e6d2f1a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.205123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a54a-6bfd-4d7c-adfa-d6ff4e6d2f1a None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.207056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 207/420] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:00.213514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fb6f5-bdda-43b1-a9e5-49a0dae01dd5 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.214149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fb6f5-bdda-43b1-a9e5-49a0dae01dd5 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.214639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fb6f5-bdda-43b1-a9e5-49a0dae01dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.233456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ee8fb6f5-bdda-43b1-a9e5-49a0dae01dd5 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:00.235203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ee8fb6f5-bdda-43b1-a9e5-49a0dae01dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:00.236582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37347c8d-febd-4f4c-953d-840deb071cc5 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.276816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95241e-6f43-4afa-9dc2-c01e54bd917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.277741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95241e-6f43-4afa-9dc2-c01e54bd917f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.278133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95241e-6f43-4afa-9dc2-c01e54bd917f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.279352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95241e-6f43-4afa-9dc2-c01e54bd917f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.316911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 208/421] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:00.356672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.396861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95241e-6f43-4afa-9dc2-c01e54bd917f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.398355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95241e-6f43-4afa-9dc2-c01e54bd917f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.403801 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fb6f5-bdda-43b1-a9e5-49a0dae01dd5 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.484400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.521141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 214/422] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:00.526918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95241e-6f43-4afa-9dc2-c01e54bd917f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.541836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fb6f5-bdda-43b1-a9e5-49a0dae01dd5 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.580464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e59a-8a06-4d5d-bbd9-781493807683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.581447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e59a-8a06-4d5d-bbd9-781493807683 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.581831 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e59a-8a06-4d5d-bbd9-781493807683 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.582203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e59a-8a06-4d5d-bbd9-781493807683 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.593482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59e59a-8a06-4d5d-bbd9-781493807683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-5b59e59a-8a06-4d5d-bbd9-781493807683 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:00.602583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:00.603558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:00.604347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 209/423] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:00.612078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e59a-8a06-4d5d-bbd9-781493807683 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.614731 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.650849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95241e-6f43-4afa-9dc2-c01e54bd917f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.687020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80793b-c51c-4962-9b46-f66234d9a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.687896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80793b-c51c-4962-9b46-f66234d9a51b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.688213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80793b-c51c-4962-9b46-f66234d9a51b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.688453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80793b-c51c-4962-9b46-f66234d9a51b None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.689716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80793b-c51c-4962-9b46-f66234d9a51b None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.691266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80793b-c51c-4962-9b46-f66234d9a51b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.693350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 215/424] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:00.698936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80793b-c51c-4962-9b46-f66234d9a51b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.734068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e59a-8a06-4d5d-bbd9-781493807683 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.758502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:00.776017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bbf73-3c10-42ef-92d1-3d86a0669cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.777063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bbf73-3c10-42ef-92d1-3d86a0669cce None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.777567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bbf73-3c10-42ef-92d1-3d86a0669cce None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.778059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bbf73-3c10-42ef-92d1-3d86a0669cce None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.779044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bbf73-3c10-42ef-92d1-3d86a0669cce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:00.779553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bbf73-3c10-42ef-92d1-3d86a0669cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.781150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bbf73-3c10-42ef-92d1-3d86a0669cce None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.790762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 210/425] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:00.799638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bbf73-3c10-42ef-92d1-3d86a0669cce None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.830118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80793b-c51c-4962-9b46-f66234d9a51b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:00.901284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a8b6-9c18-4887-ac1e-89cd9cc3636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:00.902142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a8b6-9c18-4887-ac1e-89cd9cc3636f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:00.902454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a8b6-9c18-4887-ac1e-89cd9cc3636f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:00.902738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a8b6-9c18-4887-ac1e-89cd9cc3636f None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:00.904898 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a8b6-9c18-4887-ac1e-89cd9cc3636f None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:00.906369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a8b6-9c18-4887-ac1e-89cd9cc3636f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:00.916513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 216/426] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:00.918635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a8b6-9c18-4887-ac1e-89cd9cc3636f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:00.944500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:01.048715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bbf73-3c10-42ef-92d1-3d86a0669cce None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:01.105754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a8b6-9c18-4887-ac1e-89cd9cc3636f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:01.107728 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120efe-9c65-4820-80a4-0006cbcd6106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:01.108367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120efe-9c65-4820-80a4-0006cbcd6106 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.108659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120efe-9c65-4820-80a4-0006cbcd6106 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.108943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d120efe-9c65-4820-80a4-0006cbcd6106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.166748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:01.180973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec41a-cca7-443b-b6ea-93bcf820bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:01.181996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec41a-cca7-443b-b6ea-93bcf820bde7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.182509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec41a-cca7-443b-b6ea-93bcf820bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.183007 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec41a-cca7-443b-b6ea-93bcf820bde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.184302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec41a-cca7-443b-b6ea-93bcf820bde7 None admin] RBAC: Adding query filter params (group.id=b065d9ac4854407d9b828d595e37ba83, role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=1f0cac840efb41429100d553f9c6d470) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:01.184816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec41a-cca7-443b-b6ea-93bcf820bde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:01.186515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec41a-cca7-443b-b6ea-93bcf820bde7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:01.194409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120efe-9c65-4820-80a4-0006cbcd6106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:01.194409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d120efe-9c65-4820-80a4-0006cbcd6106 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:01.200153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 217/427] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/role_assignments?group.id=b065d9ac4854407d9b828d595e37ba83&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 611 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:01.312110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 211/428] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:01.318541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec41a-cca7-443b-b6ea-93bcf820bde7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:01.423533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:01.458303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec41a-cca7-443b-b6ea-93bcf820bde7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:01.506409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529b78b-3d9a-4d95-9f24-00dee5a8af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:01.506409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529b78b-3d9a-4d95-9f24-00dee5a8af12 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.506409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529b78b-3d9a-4d95-9f24-00dee5a8af12 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.506409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529b78b-3d9a-4d95-9f24-00dee5a8af12 None admin] PATH_INFO: `/v3/projects/1f0cac840efb41429100d553f9c6d470` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.506816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529b78b-3d9a-4d95-9f24-00dee5a8af12 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0cac840efb41429100d553f9c6d470)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:01.506884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529b78b-3d9a-4d95-9f24-00dee5a8af12 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:01.509916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 218/429] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:01 2022] GET /identity/v3/projects/1f0cac840efb41429100d553f9c6d470 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:01.515754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120efe-9c65-4820-80a4-0006cbcd6106 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:01.545697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6525856-fa4d-4a1a-9c3f-1f0e8dd69b86 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.546014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6525856-fa4d-4a1a-9c3f-1f0e8dd69b86 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.546260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6525856-fa4d-4a1a-9c3f-1f0e8dd69b86 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.547979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 219/430] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:01.553280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722f56-bd45-42bb-9e80-107cd8b69e8b None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.553576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722f56-bd45-42bb-9e80-107cd8b69e8b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.553859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722f56-bd45-42bb-9e80-107cd8b69e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.571930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-61722f56-bd45-42bb-9e80-107cd8b69e8b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:01.573049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-61722f56-bd45-42bb-9e80-107cd8b69e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:01.613770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:01.637207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d120efe-9c65-4820-80a4-0006cbcd6106 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:01.657246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 220/431] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:01.685581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61722f56-bd45-42bb-9e80-107cd8b69e8b None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:01.687562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772077b1-5b9c-4c4b-9979-11b72efef1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:01.689188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772077b1-5b9c-4c4b-9979-11b72efef1b4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.689477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772077b1-5b9c-4c4b-9979-11b72efef1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.689752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772077b1-5b9c-4c4b-9979-11b72efef1b4 None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.693024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772077b1-5b9c-4c4b-9979-11b72efef1b4 None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:01.694658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772077b1-5b9c-4c4b-9979-11b72efef1b4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:01.696711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 212/432] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:01 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:01.703897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772077b1-5b9c-4c4b-9979-11b72efef1b4 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:01.772971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:01.805937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61722f56-bd45-42bb-9e80-107cd8b69e8b None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:01.828882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772077b1-5b9c-4c4b-9979-11b72efef1b4 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:01.845464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d95429-c75a-41cc-acaf-a8db03800de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:01.846685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d95429-c75a-41cc-acaf-a8db03800de5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.847195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d95429-c75a-41cc-acaf-a8db03800de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.847664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d95429-c75a-41cc-acaf-a8db03800de5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.860311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d95429-c75a-41cc-acaf-a8db03800de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-a0d95429-c75a-41cc-acaf-a8db03800de5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:01.869503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:01.870479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 18:37:01.871307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:01.871920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 221/433] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:01.878720 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef4891-46b6-4a52-bb16-3137b68aa1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:01.879060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d95429-c75a-41cc-acaf-a8db03800de5 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:01.879401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef4891-46b6-4a52-bb16-3137b68aa1a0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.879682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef4891-46b6-4a52-bb16-3137b68aa1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.879952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef4891-46b6-4a52-bb16-3137b68aa1a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.880808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef4891-46b6-4a52-bb16-3137b68aa1a0 None admin] RBAC: Adding query filter params (group.id=b065d9ac4854407d9b828d595e37ba83, role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=1f0cac840efb41429100d553f9c6d470) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:01.881117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef4891-46b6-4a52-bb16-3137b68aa1a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:01.882613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef4891-46b6-4a52-bb16-3137b68aa1a0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:01.892234 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 213/434] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:01 2022] GET /identity/v3/role_assignments?group.id=b065d9ac4854407d9b828d595e37ba83&scope.project.id=1f0cac840efb41429100d553f9c6d470&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:01.915212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd115f31-dccf-4293-9aac-a8d591ec5cb6 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.915537 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd115f31-dccf-4293-9aac-a8d591ec5cb6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.915768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd115f31-dccf-4293-9aac-a8d591ec5cb6 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.917535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 214/435] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:01.924951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc621ed-b5e6-4f2a-b554-0fa53bf9f554 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:01.925256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc621ed-b5e6-4f2a-b554-0fa53bf9f554 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:01.925500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc621ed-b5e6-4f2a-b554-0fa53bf9f554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:01.956341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-6fc621ed-b5e6-4f2a-b554-0fa53bf9f554 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:01.957214 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6fc621ed-b5e6-4f2a-b554-0fa53bf9f554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:01.975159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.023149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d95429-c75a-41cc-acaf-a8db03800de5 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.058103 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.066422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d71b3-1fc1-47a6-8bff-c050159f5ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.066422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d71b3-1fc1-47a6-8bff-c050159f5ac0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.066422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d71b3-1fc1-47a6-8bff-c050159f5ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.066422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d71b3-1fc1-47a6-8bff-c050159f5ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.066817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d71b3-1fc1-47a6-8bff-c050159f5ac0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:02.067008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d71b3-1fc1-47a6-8bff-c050159f5ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.067362 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 215/436] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:02.068350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d71b3-1fc1-47a6-8bff-c050159f5ac0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.079734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 222/437] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:37:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:02.087267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc621ed-b5e6-4f2a-b554-0fa53bf9f554 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.096873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d71b3-1fc1-47a6-8bff-c050159f5ac0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.231691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc621ed-b5e6-4f2a-b554-0fa53bf9f554 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.250222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d71b3-1fc1-47a6-8bff-c050159f5ac0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.278913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5dd87-4271-4c4a-bba4-39ee26956dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.279516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5dd87-4271-4c4a-bba4-39ee26956dff None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.279800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5dd87-4271-4c4a-bba4-39ee26956dff None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.280080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5dd87-4271-4c4a-bba4-39ee26956dff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.301767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.303417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda72cf-9d4a-40dd-9632-2d5fdc7b012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.304509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda72cf-9d4a-40dd-9632-2d5fdc7b012d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.304726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda72cf-9d4a-40dd-9632-2d5fdc7b012d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.305106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda72cf-9d4a-40dd-9632-2d5fdc7b012d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.318546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda72cf-9d4a-40dd-9632-2d5fdc7b012d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-ffda72cf-9d4a-40dd-9632-2d5fdc7b012d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:02.327334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:02.328284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:02.329065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 223/438] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:02.337874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda72cf-9d4a-40dd-9632-2d5fdc7b012d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.375495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5dd87-4271-4c4a-bba4-39ee26956dff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.377749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5dd87-4271-4c4a-bba4-39ee26956dff None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.414707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.478736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda72cf-9d4a-40dd-9632-2d5fdc7b012d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.517966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 216/439] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:02.523975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5dd87-4271-4c4a-bba4-39ee26956dff None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.531916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de202e-b599-4722-b402-871af618ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.532641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de202e-b599-4722-b402-871af618ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.532924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de202e-b599-4722-b402-871af618ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.533201 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de202e-b599-4722-b402-871af618ccf2 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.533973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de202e-b599-4722-b402-871af618ccf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:02.534282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de202e-b599-4722-b402-871af618ccf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.536394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de202e-b599-4722-b402-871af618ccf2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.550827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 224/440] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:02.551966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de202e-b599-4722-b402-871af618ccf2 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.582815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.649052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5dd87-4271-4c4a-bba4-39ee26956dff None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.663031 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de202e-b599-4722-b402-871af618ccf2 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.678229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.698104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fbc0b-3a96-41a2-8e6b-b78b635b4852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.699014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fbc0b-3a96-41a2-8e6b-b78b635b4852 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.699339 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fbc0b-3a96-41a2-8e6b-b78b635b4852 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.699574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fbc0b-3a96-41a2-8e6b-b78b635b4852 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.700798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fbc0b-3a96-41a2-8e6b-b78b635b4852 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.701664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b7cb-351e-43d4-b7fa-944f90dd7ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.702271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fbc0b-3a96-41a2-8e6b-b78b635b4852 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.702366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b7cb-351e-43d4-b7fa-944f90dd7ef1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.702624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b7cb-351e-43d4-b7fa-944f90dd7ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.702900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b7cb-351e-43d4-b7fa-944f90dd7ef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.704199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 217/441] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:02.713624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fbc0b-3a96-41a2-8e6b-b78b635b4852 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.781081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20b7cb-351e-43d4-b7fa-944f90dd7ef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.783217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20b7cb-351e-43d4-b7fa-944f90dd7ef1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.837385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fbc0b-3a96-41a2-8e6b-b78b635b4852 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:02.856642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:02.883049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eb43e-1ce1-4552-b146-77f92f1f3f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:02.883651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eb43e-1ce1-4552-b146-77f92f1f3f12 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:02.883938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eb43e-1ce1-4552-b146-77f92f1f3f12 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:02.884215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eb43e-1ce1-4552-b146-77f92f1f3f12 None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:02.885559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eb43e-1ce1-4552-b146-77f92f1f3f12 None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:02.887131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eb43e-1ce1-4552-b146-77f92f1f3f12 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:02.893982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 218/442] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:02.896291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eb43e-1ce1-4552-b146-77f92f1f3f12 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.911490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 225/443] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:02.912429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b7cb-351e-43d4-b7fa-944f90dd7ef1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:02.929505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:03.007176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eb43e-1ce1-4552-b146-77f92f1f3f12 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.017528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b7cb-351e-43d4-b7fa-944f90dd7ef1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.040948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ed9c3-3798-4076-b067-d7bd13a6edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.041602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed9c3-3798-4076-b067-d7bd13a6edd5 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.041891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed9c3-3798-4076-b067-d7bd13a6edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.042170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ed9c3-3798-4076-b067-d7bd13a6edd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.043040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ed9c3-3798-4076-b067-d7bd13a6edd5 None admin] RBAC: Adding query filter params (group.id=b065d9ac4854407d9b828d595e37ba83, role.id=78293db45f4044a093a98d4ab1475ca9, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:03.043359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ed9c3-3798-4076-b067-d7bd13a6edd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.044817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ed9c3-3798-4076-b067-d7bd13a6edd5 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.051292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 219/444] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/role_assignments?group.id=b065d9ac4854407d9b828d595e37ba83&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=78293db45f4044a093a98d4ab1475ca9 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:03.051452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a84862-7c40-4f42-b043-adff7cd2de02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.052286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a84862-7c40-4f42-b043-adff7cd2de02 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.052509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864fddf-dc09-446e-9c85-d5b4799922eb None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.052600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a84862-7c40-4f42-b043-adff7cd2de02 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.052799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864fddf-dc09-446e-9c85-d5b4799922eb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.052886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a84862-7c40-4f42-b043-adff7cd2de02 None admin] PATH_INFO: `/v3/projects/9b921b8affc14177a85b3aac3f02deca` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.053122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864fddf-dc09-446e-9c85-d5b4799922eb None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.054024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a84862-7c40-4f42-b043-adff7cd2de02 None admin] RBAC: Authorizing `identity:get_project(project_id=9b921b8affc14177a85b3aac3f02deca)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.054605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 220/445] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:03.055553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a84862-7c40-4f42-b043-adff7cd2de02 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.057450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 226/446] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:02 2022] GET /identity/v3/projects/9b921b8affc14177a85b3aac3f02deca => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:03.063081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af5f9-105e-43a3-bae5-eb09b7f16279 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.063081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af5f9-105e-43a3-bae5-eb09b7f16279 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.063081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af5f9-105e-43a3-bae5-eb09b7f16279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.064156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a84862-7c40-4f42-b043-adff7cd2de02 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:03.081505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-b37af5f9-105e-43a3-bae5-eb09b7f16279 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:03.082835 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b37af5f9-105e-43a3-bae5-eb09b7f16279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:03.131601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:03.159480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:03.162719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 221/447] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:03.180415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a84862-7c40-4f42-b043-adff7cd2de02 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.186414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37af5f9-105e-43a3-bae5-eb09b7f16279 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:03.218362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5667f-9ccf-42aa-8c50-3d06cbd391e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.219245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5667f-9ccf-42aa-8c50-3d06cbd391e8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.219531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5667f-9ccf-42aa-8c50-3d06cbd391e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.219808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5667f-9ccf-42aa-8c50-3d06cbd391e8 None admin] PATH_INFO: `/v3/groups/cb6c3432131548809068e6d3a1c7da76` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.221022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5667f-9ccf-42aa-8c50-3d06cbd391e8 None admin] RBAC: Authorizing `identity:get_group(group_id=cb6c3432131548809068e6d3a1c7da76)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.222492 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5667f-9ccf-42aa-8c50-3d06cbd391e8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.224411 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 227/448] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:03 2022] GET /identity/v3/groups/cb6c3432131548809068e6d3a1c7da76 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:03.230212 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5667f-9ccf-42aa-8c50-3d06cbd391e8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:03.306425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37af5f9-105e-43a3-bae5-eb09b7f16279 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.345824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433620a-b7ad-40cb-93ce-1fa55828d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.346709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433620a-b7ad-40cb-93ce-1fa55828d588 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.346989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433620a-b7ad-40cb-93ce-1fa55828d588 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.347260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433620a-b7ad-40cb-93ce-1fa55828d588 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.348248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5667f-9ccf-42aa-8c50-3d06cbd391e8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.361158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433620a-b7ad-40cb-93ce-1fa55828d588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-0433620a-b7ad-40cb-93ce-1fa55828d588 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:03.369281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:03.370190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:03.371209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 222/449] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:03.376230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433620a-b7ad-40cb-93ce-1fa55828d588 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:03.391049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa667ca5-c6a2-4cbc-80bb-9f10046ce0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.391529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa667ca5-c6a2-4cbc-80bb-9f10046ce0ff None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.391815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa667ca5-c6a2-4cbc-80bb-9f10046ce0ff None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.392618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa667ca5-c6a2-4cbc-80bb-9f10046ce0ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.393459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa667ca5-c6a2-4cbc-80bb-9f10046ce0ff None admin] RBAC: Adding query filter params (group.id=cb6c3432131548809068e6d3a1c7da76, role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=9b921b8affc14177a85b3aac3f02deca) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:03.393779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa667ca5-c6a2-4cbc-80bb-9f10046ce0ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.395436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa667ca5-c6a2-4cbc-80bb-9f10046ce0ff None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.406416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 228/450] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:03 2022] GET /identity/v3/role_assignments?group.id=cb6c3432131548809068e6d3a1c7da76&scope.project.id=9b921b8affc14177a85b3aac3f02deca&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:03.425335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:03.503739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433620a-b7ad-40cb-93ce-1fa55828d588 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.540213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d7733-6c23-4048-85bc-8a7633c49b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.540901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d7733-6c23-4048-85bc-8a7633c49b80 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.541192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d7733-6c23-4048-85bc-8a7633c49b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.541473 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d7733-6c23-4048-85bc-8a7633c49b80 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.542240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d7733-6c23-4048-85bc-8a7633c49b80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:03.542584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d7733-6c23-4048-85bc-8a7633c49b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.544015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d7733-6c23-4048-85bc-8a7633c49b80 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.553048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 223/451] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:03.559005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa667ca5-c6a2-4cbc-80bb-9f10046ce0ff None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:03.578314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:03.662064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa667ca5-c6a2-4cbc-80bb-9f10046ce0ff None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.694437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4cce-e0a5-456a-97cc-15e4c649f0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.695029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4cce-e0a5-456a-97cc-15e4c649f0c0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.695312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4cce-e0a5-456a-97cc-15e4c649f0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.695590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4cce-e0a5-456a-97cc-15e4c649f0c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.759683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd4cce-e0a5-456a-97cc-15e4c649f0c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.761114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd4cce-e0a5-456a-97cc-15e4c649f0c0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.775537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:03.855964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 229/452] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:03.862280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d7733-6c23-4048-85bc-8a7633c49b80 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:03.953101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:03.958750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d7733-6c23-4048-85bc-8a7633c49b80 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:03.990921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5232-d89a-4ac4-a3cf-e21ef4967497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:03.991773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5232-d89a-4ac4-a3cf-e21ef4967497 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:03.992058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5232-d89a-4ac4-a3cf-e21ef4967497 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:03.992334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5232-d89a-4ac4-a3cf-e21ef4967497 None admin] PATH_INFO: `/v3/projects/e8cc7688c6d046abad0e3ebd04723c92` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:03.993510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5232-d89a-4ac4-a3cf-e21ef4967497 None admin] RBAC: Authorizing `identity:get_project(project_id=e8cc7688c6d046abad0e3ebd04723c92)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:03.994980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5232-d89a-4ac4-a3cf-e21ef4967497 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:03.996647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 224/453] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:37:03 2022] GET /identity/v3/projects/e8cc7688c6d046abad0e3ebd04723c92 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:04.002735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4cce-e0a5-456a-97cc-15e4c649f0c0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:04.097148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4cce-e0a5-456a-97cc-15e4c649f0c0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:04.111178 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:04.131115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c3894-3d0d-4501-898a-aa861fe5fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:04.131956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c3894-3d0d-4501-898a-aa861fe5fc21 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:04.132238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c3894-3d0d-4501-898a-aa861fe5fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:04.132512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c3894-3d0d-4501-898a-aa861fe5fc21 None admin] PATH_INFO: `/v3/groups/b065d9ac4854407d9b828d595e37ba83` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:04.133647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c3894-3d0d-4501-898a-aa861fe5fc21 None admin] RBAC: Authorizing `identity:get_group(group_id=b065d9ac4854407d9b828d595e37ba83)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:04.135082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c3894-3d0d-4501-898a-aa861fe5fc21 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:04.136661 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 230/454] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jun 16 18:37:04 2022] GET /identity/v3/groups/b065d9ac4854407d9b828d595e37ba83 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:04.142663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5232-d89a-4ac4-a3cf-e21ef4967497 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:04.242654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5232-d89a-4ac4-a3cf-e21ef4967497 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:04.273901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2b353-06b0-4978-bb60-623bda33db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:04.274578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2b353-06b0-4978-bb60-623bda33db22 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:04.274863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2b353-06b0-4978-bb60-623bda33db22 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:04.275140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2b353-06b0-4978-bb60-623bda33db22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:04.275959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2b353-06b0-4978-bb60-623bda33db22 None admin] RBAC: Adding query filter params (group.id=b065d9ac4854407d9b828d595e37ba83, role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=e8cc7688c6d046abad0e3ebd04723c92) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:04.276270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2b353-06b0-4978-bb60-623bda33db22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:04.277700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2b353-06b0-4978-bb60-623bda33db22 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:04.283880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 225/455] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jun 16 18:37:04 2022] GET /identity/v3/role_assignments?group.id=b065d9ac4854407d9b828d595e37ba83&scope.project.id=e8cc7688c6d046abad0e3ebd04723c92&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:06.932162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22247a02-9f3f-481c-a833-86d7858e47df None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.933223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22247a02-9f3f-481c-a833-86d7858e47df None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.933716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22247a02-9f3f-481c-a833-86d7858e47df None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.935947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 231/456] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:06.942523 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56be9d-e5de-4ca6-929c-1717208e26eb None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:06.942964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56be9d-e5de-4ca6-929c-1717208e26eb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:06.943085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56be9d-e5de-4ca6-929c-1717208e26eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:06.967369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-0f56be9d-e5de-4ca6-929c-1717208e26eb None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:06.968838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0f56be9d-e5de-4ca6-929c-1717208e26eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:06.996514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.063759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 226/457] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:07.088562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22247a02-9f3f-481c-a833-86d7858e47df None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.228039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22247a02-9f3f-481c-a833-86d7858e47df None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.277987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fe7ec-a12a-4a21-a8cf-97f9b6bdef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.279057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fe7ec-a12a-4a21-a8cf-97f9b6bdef98 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.279488 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fe7ec-a12a-4a21-a8cf-97f9b6bdef98 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.279909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fe7ec-a12a-4a21-a8cf-97f9b6bdef98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.291941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fe7ec-a12a-4a21-a8cf-97f9b6bdef98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:07.293585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fe7ec-a12a-4a21-a8cf-97f9b6bdef98 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-a98fe7ec-a12a-4a21-a8cf-97f9b6bdef98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:07.317235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:07.318280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:07.319349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:07.319349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:07.319349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:07.319349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:07.321179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 232/458] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:07.331810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56be9d-e5de-4ca6-929c-1717208e26eb None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.429732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510874-1d66-48d5-99ed-af0418b3b76f None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.430370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510874-1d66-48d5-99ed-af0418b3b76f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.430877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510874-1d66-48d5-99ed-af0418b3b76f None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.432977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 233/459] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:07.437978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750baf-42a4-437f-a2d7-6970f9687949 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.438560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750baf-42a4-437f-a2d7-6970f9687949 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.439077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750baf-42a4-437f-a2d7-6970f9687949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.492004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e3750baf-42a4-437f-a2d7-6970f9687949 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:07.493476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e3750baf-42a4-437f-a2d7-6970f9687949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:07.524728 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56be9d-e5de-4ca6-929c-1717208e26eb None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.557140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.595135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a854aa0-9524-48dc-9cf4-40dcb6492f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.596596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a854aa0-9524-48dc-9cf4-40dcb6492f5f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.597049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a854aa0-9524-48dc-9cf4-40dcb6492f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.597463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a854aa0-9524-48dc-9cf4-40dcb6492f5f None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.598322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a854aa0-9524-48dc-9cf4-40dcb6492f5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:07.598794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a854aa0-9524-48dc-9cf4-40dcb6492f5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:07.600313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a854aa0-9524-48dc-9cf4-40dcb6492f5f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:07.614495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 227/460] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:07.616013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3de6d-5ad7-4da7-a096-53674e5d7ad9 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.616440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3de6d-5ad7-4da7-a096-53674e5d7ad9 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.616854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3de6d-5ad7-4da7-a096-53674e5d7ad9 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.622293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 228/461] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:07.622897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3de6d-5ad7-4da7-a096-53674e5d7ad9 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.626353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 234/462] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:07.628932 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfbfee-0285-4438-bb17-8483cdaa654f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.629366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfbfee-0285-4438-bb17-8483cdaa654f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.629781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfbfee-0285-4438-bb17-8483cdaa654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.645150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.652438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-15cfbfee-0285-4438-bb17-8483cdaa654f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:07.654434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-15cfbfee-0285-4438-bb17-8483cdaa654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:07.738531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3de6d-5ad7-4da7-a096-53674e5d7ad9 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.746288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 235/463] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:07.754412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfbfee-0285-4438-bb17-8483cdaa654f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.798410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecd372-876b-4234-bc67-f157225006c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.799626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecd372-876b-4234-bc67-f157225006c3 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.800109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecd372-876b-4234-bc67-f157225006c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.800574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecd372-876b-4234-bc67-f157225006c3 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:07.801473 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecd372-876b-4234-bc67-f157225006c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:07.803349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecd372-876b-4234-bc67-f157225006c3 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:07.827327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 229/464] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:07 2022] POST /identity/v3/users => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:07.828557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecd372-876b-4234-bc67-f157225006c3 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:07.881347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.896297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfbfee-0285-4438-bb17-8483cdaa654f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.916497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:07.949340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecd372-876b-4234-bc67-f157225006c3 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:07.984361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425ce0-fbfd-47bc-9b8c-7812dc3d332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:07.985585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425ce0-fbfd-47bc-9b8c-7812dc3d332e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:07.986674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425ce0-fbfd-47bc-9b8c-7812dc3d332e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:07.987150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425ce0-fbfd-47bc-9b8c-7812dc3d332e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.018519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222f8d9-7b55-4cd4-ac85-5417eba1b71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.019412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222f8d9-7b55-4cd4-ac85-5417eba1b71e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.019744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222f8d9-7b55-4cd4-ac85-5417eba1b71e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.020067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222f8d9-7b55-4cd4-ac85-5417eba1b71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.025570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425ce0-fbfd-47bc-9b8c-7812dc3d332e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.027386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425ce0-fbfd-47bc-9b8c-7812dc3d332e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.052808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222f8d9-7b55-4cd4-ac85-5417eba1b71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.054333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222f8d9-7b55-4cd4-ac85-5417eba1b71e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-b7425ce0-fbfd-47bc-9b8c-7812dc3d332e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:08.066204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:08.067120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:08.067937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:08.067937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:08.067937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:08.067937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:08.067937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 236/465] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:08.073153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425ce0-fbfd-47bc-9b8c-7812dc3d332e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-0222f8d9-7b55-4cd4-ac85-5417eba1b71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:08.084091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:08.084987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:08.085813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:08.085813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:08.085813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:08.085813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:08.087885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 230/466] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:08.094770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222f8d9-7b55-4cd4-ac85-5417eba1b71e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.217542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425ce0-fbfd-47bc-9b8c-7812dc3d332e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.226597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222f8d9-7b55-4cd4-ac85-5417eba1b71e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.255529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.258762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c62d6-2af0-4184-9ac3-4f741eca0e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.259436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c62d6-2af0-4184-9ac3-4f741eca0e81 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.259720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c62d6-2af0-4184-9ac3-4f741eca0e81 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.260266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c62d6-2af0-4184-9ac3-4f741eca0e81 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.260718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c62d6-2af0-4184-9ac3-4f741eca0e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:08.261027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c62d6-2af0-4184-9ac3-4f741eca0e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.262461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c62d6-2af0-4184-9ac3-4f741eca0e81 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.265528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198804a2-9587-4a5d-b5e8-88ab1013f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.266199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198804a2-9587-4a5d-b5e8-88ab1013f3fc None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.266518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198804a2-9587-4a5d-b5e8-88ab1013f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.266803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198804a2-9587-4a5d-b5e8-88ab1013f3fc None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.267628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198804a2-9587-4a5d-b5e8-88ab1013f3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:08.267950 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198804a2-9587-4a5d-b5e8-88ab1013f3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.269387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198804a2-9587-4a5d-b5e8-88ab1013f3fc None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.274936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 237/467] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:08.276058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd959c97-d123-479d-bac8-a2e14d5fca7b None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.276343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd959c97-d123-479d-bac8-a2e14d5fca7b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.276628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd959c97-d123-479d-bac8-a2e14d5fca7b None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.277859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 238/468] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:08.283831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dd706-dfc1-4c0a-a2fe-115d1a8598af None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.284122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dd706-dfc1-4c0a-a2fe-115d1a8598af None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.284400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dd706-dfc1-4c0a-a2fe-115d1a8598af None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.285862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 239/469] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:08.286878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 231/470] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:08.287204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7b4ed-b11c-441a-a124-d0bd5f0542c1 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.287637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7b4ed-b11c-441a-a124-d0bd5f0542c1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.287977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7b4ed-b11c-441a-a124-d0bd5f0542c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.288485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198804a2-9587-4a5d-b5e8-88ab1013f3fc None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.302289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.309519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-27b7b4ed-b11c-441a-a124-d0bd5f0542c1 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:08.310846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-27b7b4ed-b11c-441a-a124-d0bd5f0542c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:08.395421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 240/471] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:08.397277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb569be-4c4a-4176-8753-49113d679bcc None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.397770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb569be-4c4a-4176-8753-49113d679bcc None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.398163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb569be-4c4a-4176-8753-49113d679bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.413679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198804a2-9587-4a5d-b5e8-88ab1013f3fc None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.428349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-0bb569be-4c4a-4176-8753-49113d679bcc None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:08.429553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0bb569be-4c4a-4176-8753-49113d679bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:08.453680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b621c-305c-4864-895e-26571785b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.454351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b621c-305c-4864-895e-26571785b174 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.454662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b621c-305c-4864-895e-26571785b174 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.455461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b621c-305c-4864-895e-26571785b174 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.456330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b621c-305c-4864-895e-26571785b174 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.457946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b621c-305c-4864-895e-26571785b174 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.478928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 232/472] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:08 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:08.491559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b621c-305c-4864-895e-26571785b174 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.526429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 241/473] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:08.531454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb569be-4c4a-4176-8753-49113d679bcc None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.565431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.612633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.633516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b621c-305c-4864-895e-26571785b174 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.651360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb569be-4c4a-4176-8753-49113d679bcc None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.673191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860d19f-dea8-40eb-9f68-22d48af514ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.674073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d19f-dea8-40eb-9f68-22d48af514ae None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.674452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d19f-dea8-40eb-9f68-22d48af514ae None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.674801 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d19f-dea8-40eb-9f68-22d48af514ae None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.675591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860d19f-dea8-40eb-9f68-22d48af514ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.677234 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860d19f-dea8-40eb-9f68-22d48af514ae None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.697882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373c684-77bb-4353-a47d-c861d17067fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.699117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373c684-77bb-4353-a47d-c861d17067fd None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.699449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373c684-77bb-4353-a47d-c861d17067fd None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.699732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373c684-77bb-4353-a47d-c861d17067fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.701163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 233/474] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:08 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:08.701981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860d19f-dea8-40eb-9f68-22d48af514ae None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.711995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373c684-77bb-4353-a47d-c861d17067fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.713620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373c684-77bb-4353-a47d-c861d17067fd None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-9373c684-77bb-4353-a47d-c861d17067fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:08.734580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:08.735457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:08.736314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:08.736314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:08.736314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:08.736314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:08.736314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 242/475] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:08.741844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373c684-77bb-4353-a47d-c861d17067fd None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.848564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.859737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860d19f-dea8-40eb-9f68-22d48af514ae None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.903707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373c684-77bb-4353-a47d-c861d17067fd None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:08.906291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.907028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.907314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.907592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.908647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.910094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.917146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.sql.core [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 18:37:08.917146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 18:37:08.917146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [parameters: {'id': 'fc09a6dc3c7e4fa48f729f76b7505039', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 18:37:08.917146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86898) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 18:37:08.927099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application result.read() Jun 16 18:37:08.937511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:37:08.938603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application yield resource Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise self.value Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application session.commit() Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 18:37:08.940225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.session.flush() Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application compat.raise_( Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 18:37:08.941071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:37:08.941944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application result.read() Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:37:08.942787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [parameters: {'id': 'fc09a6dc3c7e4fa48f729f76b7505039', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:08.943581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 18:37:08.944380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:08.948298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 234/476] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jun 16 18:37:08 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:08.953536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9947b7-23a5-4513-a666-9f2c658c4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:08.954284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9947b7-23a5-4513-a666-9f2c658c4477 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:08.954622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9947b7-23a5-4513-a666-9f2c658c4477 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:08.955497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9947b7-23a5-4513-a666-9f2c658c4477 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:08.956246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9947b7-23a5-4513-a666-9f2c658c4477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:08.956557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9947b7-23a5-4513-a666-9f2c658c4477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:08.957936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9947b7-23a5-4513-a666-9f2c658c4477 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:08.962065 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:08.974539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 243/477] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:08.981048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9947b7-23a5-4513-a666-9f2c658c4477 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:09.087194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3046-35f9-4b41-bc23-949db450b3b2 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:09.130833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd6854-d75b-4819-b4f5-a4dcbf0f954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:09.131428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9947b7-23a5-4513-a666-9f2c658c4477 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:09.132536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd6854-d75b-4819-b4f5-a4dcbf0f954a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:09.133014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd6854-d75b-4819-b4f5-a4dcbf0f954a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:09.133482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd6854-d75b-4819-b4f5-a4dcbf0f954a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:09.146810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd6854-d75b-4819-b4f5-a4dcbf0f954a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-59bd6854-d75b-4819-b4f5-a4dcbf0f954a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:09.156945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:09.157882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 18:37:09.158791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:09.161663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 235/478] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:09.175308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd6854-d75b-4819-b4f5-a4dcbf0f954a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:09.196277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0278c7-38b7-4a8e-8cdf-8b0fab6159e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:09.196960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0278c7-38b7-4a8e-8cdf-8b0fab6159e2 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:09.197242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0278c7-38b7-4a8e-8cdf-8b0fab6159e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:09.197520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0278c7-38b7-4a8e-8cdf-8b0fab6159e2 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:09.198803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0278c7-38b7-4a8e-8cdf-8b0fab6159e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:09.200686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0278c7-38b7-4a8e-8cdf-8b0fab6159e2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:09.209246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:09.232470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 244/479] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:08 2022] POST /identity/v3/users => generated 249 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:37:09.318309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd6854-d75b-4819-b4f5-a4dcbf0f954a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:09.375213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60e485-3a9f-4048-88d1-69326f67f548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:09.375914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e485-3a9f-4048-88d1-69326f67f548 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:09.376199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e485-3a9f-4048-88d1-69326f67f548 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:09.376477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60e485-3a9f-4048-88d1-69326f67f548 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:09.377289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e485-3a9f-4048-88d1-69326f67f548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:09.377593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e485-3a9f-4048-88d1-69326f67f548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:09.379066 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60e485-3a9f-4048-88d1-69326f67f548 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:09.395743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 236/480] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:10.635946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ba49-2501-4944-8a06-a9fdad815d7e None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:10.636452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ba49-2501-4944-8a06-a9fdad815d7e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:10.636804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ba49-2501-4944-8a06-a9fdad815d7e None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:10.639126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 245/481] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:10.651353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caba78-a5e4-4e73-bda7-51ae250e362e None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:10.651876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caba78-a5e4-4e73-bda7-51ae250e362e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:10.652031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caba78-a5e4-4e73-bda7-51ae250e362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:10.675348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-02caba78-a5e4-4e73-bda7-51ae250e362e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:10.676541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-02caba78-a5e4-4e73-bda7-51ae250e362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:10.769231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 237/482] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:10.800011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ba49-2501-4944-8a06-a9fdad815d7e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:10.862490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:10.972752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ba49-2501-4944-8a06-a9fdad815d7e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.023606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed9837-fcbc-4579-9b0e-54db8849e153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.024326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed9837-fcbc-4579-9b0e-54db8849e153 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.024614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed9837-fcbc-4579-9b0e-54db8849e153 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.024894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed9837-fcbc-4579-9b0e-54db8849e153 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.041934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed9837-fcbc-4579-9b0e-54db8849e153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-82ed9837-fcbc-4579-9b0e-54db8849e153 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:11.050537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:11.051551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:11.052549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 246/483] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:11.060536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caba78-a5e4-4e73-bda7-51ae250e362e None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.076656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.204761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caba78-a5e4-4e73-bda7-51ae250e362e None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.248374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcdeb9-ce60-4dcf-81b8-19bf33c80c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.249055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcdeb9-ce60-4dcf-81b8-19bf33c80c07 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.249337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcdeb9-ce60-4dcf-81b8-19bf33c80c07 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.249616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcdeb9-ce60-4dcf-81b8-19bf33c80c07 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.250414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcdeb9-ce60-4dcf-81b8-19bf33c80c07 None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:11.250716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcdeb9-ce60-4dcf-81b8-19bf33c80c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:11.252635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcdeb9-ce60-4dcf-81b8-19bf33c80c07 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:11.265489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 238/484] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:11.271544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed9837-fcbc-4579-9b0e-54db8849e153 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.382724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.397712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed9837-fcbc-4579-9b0e-54db8849e153 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.447234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f358e-284f-40ce-a924-6b5f107d0fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.448045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f358e-284f-40ce-a924-6b5f107d0fa4 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.448330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f358e-284f-40ce-a924-6b5f107d0fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.448605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f358e-284f-40ce-a924-6b5f107d0fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.462836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f358e-284f-40ce-a924-6b5f107d0fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:11.463815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125ebd3-1e97-43b5-ada7-d7362372705f None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.464333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125ebd3-1e97-43b5-ada7-d7362372705f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.464833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125ebd3-1e97-43b5-ada7-d7362372705f None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.465319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f358e-284f-40ce-a924-6b5f107d0fa4 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:11.470773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 239/485] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:11.475870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6470-a13b-474d-8337-ad8c53c47881 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.476162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6470-a13b-474d-8337-ad8c53c47881 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.476441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6470-a13b-474d-8337-ad8c53c47881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-826f358e-284f-40ce-a924-6b5f107d0fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:11.488341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:11.489209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:11.490035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:11.490035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:11.490035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:11.490035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:11.492374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 247/486] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:11.501466 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f358e-284f-40ce-a924-6b5f107d0fa4 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.523692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-982b6470-a13b-474d-8337-ad8c53c47881 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:11.525399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-982b6470-a13b-474d-8337-ad8c53c47881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:11.640507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 240/487] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:11.677146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6470-a13b-474d-8337-ad8c53c47881 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.686328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.701606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f358e-284f-40ce-a924-6b5f107d0fa4 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.750546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9c90d-9b48-48ff-9037-62074975eb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.751264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9c90d-9b48-48ff-9037-62074975eb82 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.751552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9c90d-9b48-48ff-9037-62074975eb82 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.751832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9c90d-9b48-48ff-9037-62074975eb82 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.753166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9c90d-9b48-48ff-9037-62074975eb82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:11.753484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9c90d-9b48-48ff-9037-62074975eb82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:11.755207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9c90d-9b48-48ff-9037-62074975eb82 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:11.774548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 248/488] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:11.776283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87930a55-8ba3-4b3f-8da8-cb4e2d031def None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.776807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87930a55-8ba3-4b3f-8da8-cb4e2d031def None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.777351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87930a55-8ba3-4b3f-8da8-cb4e2d031def None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.779183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 249/489] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:11.780148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87930a55-8ba3-4b3f-8da8-cb4e2d031def None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.790588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.817705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6470-a13b-474d-8337-ad8c53c47881 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.855697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc3ea-76c8-453c-92e1-95f1cdc6969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.856503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc3ea-76c8-453c-92e1-95f1cdc6969d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.856787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc3ea-76c8-453c-92e1-95f1cdc6969d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.857061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc3ea-76c8-453c-92e1-95f1cdc6969d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.869294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc3ea-76c8-453c-92e1-95f1cdc6969d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-cc3bc3ea-76c8-453c-92e1-95f1cdc6969d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:11.877437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:11.879005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:11.880434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:11.883790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 241/490] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:11.885198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8aae-4f4e-4960-af5a-fcd5c5dee858 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.885498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8aae-4f4e-4960-af5a-fcd5c5dee858 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.885780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8aae-4f4e-4960-af5a-fcd5c5dee858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.903754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-6fed8aae-4f4e-4960-af5a-fcd5c5dee858 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:11.904641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6fed8aae-4f4e-4960-af5a-fcd5c5dee858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:11.927504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87930a55-8ba3-4b3f-8da8-cb4e2d031def None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:11.964682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54011c3b-a578-4e42-9ade-6d0c48455238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:11.965852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54011c3b-a578-4e42-9ade-6d0c48455238 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:11.966326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54011c3b-a578-4e42-9ade-6d0c48455238 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:11.966858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54011c3b-a578-4e42-9ade-6d0c48455238 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:11.972600 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:11.975676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54011c3b-a578-4e42-9ade-6d0c48455238 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:11.977384 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54011c3b-a578-4e42-9ade-6d0c48455238 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:11.990756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 242/491] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:11.991679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed8aae-4f4e-4960-af5a-fcd5c5dee858 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-54011c3b-a578-4e42-9ade-6d0c48455238 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:11.995737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:11.996611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:11.997491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:12.000109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 250/492] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:12.009687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54011c3b-a578-4e42-9ade-6d0c48455238 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.099480 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed8aae-4f4e-4960-af5a-fcd5c5dee858 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.103028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.146029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b160d2-44ef-4b79-a62c-ea811de88c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.146757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b160d2-44ef-4b79-a62c-ea811de88c97 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.147071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b160d2-44ef-4b79-a62c-ea811de88c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.147354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b160d2-44ef-4b79-a62c-ea811de88c97 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.148165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b160d2-44ef-4b79-a62c-ea811de88c97 None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:12.148497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b160d2-44ef-4b79-a62c-ea811de88c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.148682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54011c3b-a578-4e42-9ade-6d0c48455238 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.149943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b160d2-44ef-4b79-a62c-ea811de88c97 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.164969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 243/493] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:12.165898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b160d2-44ef-4b79-a62c-ea811de88c97 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.186770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716070aa-5d76-4385-b875-95d199ec96a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.187775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716070aa-5d76-4385-b875-95d199ec96a5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.188257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716070aa-5d76-4385-b875-95d199ec96a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.188702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716070aa-5d76-4385-b875-95d199ec96a5 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.189970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716070aa-5d76-4385-b875-95d199ec96a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:12.190452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716070aa-5d76-4385-b875-95d199ec96a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.192025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716070aa-5d76-4385-b875-95d199ec96a5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.227962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.233225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 251/494] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:12.234256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716070aa-5d76-4385-b875-95d199ec96a5 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.282077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b160d2-44ef-4b79-a62c-ea811de88c97 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.317136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eef6f8-0346-440c-8880-0122fbd3f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.317940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef6f8-0346-440c-8880-0122fbd3f903 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.318227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef6f8-0346-440c-8880-0122fbd3f903 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.318618 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eef6f8-0346-440c-8880-0122fbd3f903 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.329450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eef6f8-0346-440c-8880-0122fbd3f903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-77eef6f8-0346-440c-8880-0122fbd3f903 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:12.337715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:12.338629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:12.339405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 244/495] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:12.340913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c541481-d427-4f94-be06-e034f22fc4cb None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.340913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c541481-d427-4f94-be06-e034f22fc4cb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.340913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c541481-d427-4f94-be06-e034f22fc4cb None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.342300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 245/496] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:12.344630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c541481-d427-4f94-be06-e034f22fc4cb None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.350228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716070aa-5d76-4385-b875-95d199ec96a5 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.373860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.384588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aed09-7b3c-499d-aa5a-4ddc25d4f82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.385373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aed09-7b3c-499d-aa5a-4ddc25d4f82b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.385655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aed09-7b3c-499d-aa5a-4ddc25d4f82b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.385929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aed09-7b3c-499d-aa5a-4ddc25d4f82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.396578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aed09-7b3c-499d-aa5a-4ddc25d4f82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.398050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aed09-7b3c-499d-aa5a-4ddc25d4f82b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-bc2aed09-7b3c-499d-aa5a-4ddc25d4f82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:12.416468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:12.417426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:12.418263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:12.418263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:12.418263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:12.418263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:12.418263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 252/497] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:12.418852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0ce4f-6145-46b3-ab02-dfdf0e62b0fe None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.419145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0ce4f-6145-46b3-ab02-dfdf0e62b0fe None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.419406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0ce4f-6145-46b3-ab02-dfdf0e62b0fe None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.420642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 253/498] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:12.421326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0ce4f-6145-46b3-ab02-dfdf0e62b0fe None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.455567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c541481-d427-4f94-be06-e034f22fc4cb None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.473062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.491493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3d0e-8b97-4988-8301-d2493ac5bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.492283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3d0e-8b97-4988-8301-d2493ac5bb24 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.492431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3d0e-8b97-4988-8301-d2493ac5bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.492767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab3d0e-8b97-4988-8301-d2493ac5bb24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.531506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0ce4f-6145-46b3-ab02-dfdf0e62b0fe None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.563793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab3d0e-8b97-4988-8301-d2493ac5bb24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.565451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12f589-0671-4697-bbcc-58fecfa7fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.565775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab3d0e-8b97-4988-8301-d2493ac5bb24 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.566107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f589-0671-4697-bbcc-58fecfa7fb48 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.566404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f589-0671-4697-bbcc-58fecfa7fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.566698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f589-0671-4697-bbcc-58fecfa7fb48 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.567435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12f589-0671-4697-bbcc-58fecfa7fb48 None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:12.567890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12f589-0671-4697-bbcc-58fecfa7fb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.569996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12f589-0671-4697-bbcc-58fecfa7fb48 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.579396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 254/499] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:12.581204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c283d-2bf5-4bdb-9d05-642f6caa02e1 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.581479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c283d-2bf5-4bdb-9d05-642f6caa02e1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.581754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c283d-2bf5-4bdb-9d05-642f6caa02e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.598204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-219c283d-2bf5-4bdb-9d05-642f6caa02e1 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:12.599628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-219c283d-2bf5-4bdb-9d05-642f6caa02e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:12.628879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.665286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 246/500] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:12.666129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3d0e-8b97-4988-8301-d2493ac5bb24 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.667619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 255/501] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:12.669062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1251b2-5449-40eb-ba8a-a2f16ef141da None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.669354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1251b2-5449-40eb-ba8a-a2f16ef141da None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.669631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1251b2-5449-40eb-ba8a-a2f16ef141da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.685993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-6e1251b2-5449-40eb-ba8a-a2f16ef141da None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:12.687215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6e1251b2-5449-40eb-ba8a-a2f16ef141da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:12.695859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.763145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 256/502] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:12.763985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1251b2-5449-40eb-ba8a-a2f16ef141da None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.788666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab3d0e-8b97-4988-8301-d2493ac5bb24 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.826108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663084ee-eead-4f7d-8236-183b6c78d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.826812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663084ee-eead-4f7d-8236-183b6c78d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.827095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663084ee-eead-4f7d-8236-183b6c78d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.827368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663084ee-eead-4f7d-8236-183b6c78d3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.828086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663084ee-eead-4f7d-8236-183b6c78d3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:12.828391 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663084ee-eead-4f7d-8236-183b6c78d3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.829756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663084ee-eead-4f7d-8236-183b6c78d3e5 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.841732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 247/503] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:12.842579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663084ee-eead-4f7d-8236-183b6c78d3e5 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.863180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.867333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1251b2-5449-40eb-ba8a-a2f16ef141da None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.907856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bfab4-7aa1-400c-a8c7-b8c5dfd9658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.908698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bfab4-7aa1-400c-a8c7-b8c5dfd9658a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.908983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bfab4-7aa1-400c-a8c7-b8c5dfd9658a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.909256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bfab4-7aa1-400c-a8c7-b8c5dfd9658a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.919652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bfab4-7aa1-400c-a8c7-b8c5dfd9658a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.921035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bfab4-7aa1-400c-a8c7-b8c5dfd9658a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:12.922298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-7c9bfab4-7aa1-400c-a8c7-b8c5dfd9658a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:12.940168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:12.941054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:12.941970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:12.941970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:12.941970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:12.941970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:12.941970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 257/504] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:12.942235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bfab4-7aa1-400c-a8c7-b8c5dfd9658a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:12.948368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663084ee-eead-4f7d-8236-183b6c78d3e5 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:12.982125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fa60f-5292-4079-8f3a-8a1f046fc15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:12.982941 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fa60f-5292-4079-8f3a-8a1f046fc15e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:12.983228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fa60f-5292-4079-8f3a-8a1f046fc15e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:12.983502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fa60f-5292-4079-8f3a-8a1f046fc15e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:12.994931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fa60f-5292-4079-8f3a-8a1f046fc15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:12.996372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fa60f-5292-4079-8f3a-8a1f046fc15e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-f34fa60f-5292-4079-8f3a-8a1f046fc15e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:13.014766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:13.015702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:13.021621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:13.021621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:13.021621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:13.021621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:13.021621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 248/505] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:13.021621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fa60f-5292-4079-8f3a-8a1f046fc15e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.042542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bfab4-7aa1-400c-a8c7-b8c5dfd9658a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.078666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2e6da-a39b-46d7-99c5-bd7e6798688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.079461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2e6da-a39b-46d7-99c5-bd7e6798688e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.079746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2e6da-a39b-46d7-99c5-bd7e6798688e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.080024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2e6da-a39b-46d7-99c5-bd7e6798688e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.091086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2e6da-a39b-46d7-99c5-bd7e6798688e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.092521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2e6da-a39b-46d7-99c5-bd7e6798688e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e0d2e6da-a39b-46d7-99c5-bd7e6798688e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:13.110816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:13.111828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:13.112699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:13.112699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:13.112699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:13.112699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:13.112699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 258/506] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:13.112979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2e6da-a39b-46d7-99c5-bd7e6798688e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.119516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.123709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fa60f-5292-4079-8f3a-8a1f046fc15e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.152781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.159351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65d6e-50eb-4682-9eda-7c34bf90e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.160141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65d6e-50eb-4682-9eda-7c34bf90e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.160428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65d6e-50eb-4682-9eda-7c34bf90e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.160696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65d6e-50eb-4682-9eda-7c34bf90e9c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.171086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d65d6e-50eb-4682-9eda-7c34bf90e9c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-87d65d6e-50eb-4682-9eda-7c34bf90e9c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:13.178686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:13.179704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:13.180478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 249/507] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:13.181128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65d6e-50eb-4682-9eda-7c34bf90e9c3 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.228997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2e6da-a39b-46d7-99c5-bd7e6798688e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.262077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77106944-9ea8-4f26-89ff-8accd6e2edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.262903 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77106944-9ea8-4f26-89ff-8accd6e2edb1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.263186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77106944-9ea8-4f26-89ff-8accd6e2edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.263460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77106944-9ea8-4f26-89ff-8accd6e2edb1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.271458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77106944-9ea8-4f26-89ff-8accd6e2edb1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.272902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77106944-9ea8-4f26-89ff-8accd6e2edb1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.282973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65d6e-50eb-4682-9eda-7c34bf90e9c3 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-77106944-9ea8-4f26-89ff-8accd6e2edb1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:13.286803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:13.287648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:13.288530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 259/508] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:13.289076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77106944-9ea8-4f26-89ff-8accd6e2edb1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.319601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8241fe-ee08-4d5f-81c6-e551024cbc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.320260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8241fe-ee08-4d5f-81c6-e551024cbc3f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.320542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8241fe-ee08-4d5f-81c6-e551024cbc3f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.320817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8241fe-ee08-4d5f-81c6-e551024cbc3f None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.321527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8241fe-ee08-4d5f-81c6-e551024cbc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:13.321829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8241fe-ee08-4d5f-81c6-e551024cbc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.323232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8241fe-ee08-4d5f-81c6-e551024cbc3f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.335927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 250/509] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:13.336716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8241fe-ee08-4d5f-81c6-e551024cbc3f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.350420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.387048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.389239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77106944-9ea8-4f26-89ff-8accd6e2edb1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.422709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69622c58-c4d8-4823-9de4-376a0cc70866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.423295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69622c58-c4d8-4823-9de4-376a0cc70866 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.423576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69622c58-c4d8-4823-9de4-376a0cc70866 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.423868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69622c58-c4d8-4823-9de4-376a0cc70866 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.424592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69622c58-c4d8-4823-9de4-376a0cc70866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:13.424907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69622c58-c4d8-4823-9de4-376a0cc70866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.426399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69622c58-c4d8-4823-9de4-376a0cc70866 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.435846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8241fe-ee08-4d5f-81c6-e551024cbc3f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.438963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 260/510] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:13.440280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69622c58-c4d8-4823-9de4-376a0cc70866 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.470469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929ce6-cd2c-4726-afb8-cd69b981a5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.471182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929ce6-cd2c-4726-afb8-cd69b981a5f2 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.471463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929ce6-cd2c-4726-afb8-cd69b981a5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.471735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929ce6-cd2c-4726-afb8-cd69b981a5f2 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.472447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39929ce6-cd2c-4726-afb8-cd69b981a5f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:13.472742 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39929ce6-cd2c-4726-afb8-cd69b981a5f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.474110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39929ce6-cd2c-4726-afb8-cd69b981a5f2 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.488578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 251/511] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:13.489589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929ce6-cd2c-4726-afb8-cd69b981a5f2 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.544851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69622c58-c4d8-4823-9de4-376a0cc70866 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.567899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.579547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee4ea-b39c-40fa-aa65-f29d8a51ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.580804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee4ea-b39c-40fa-aa65-f29d8a51ec3e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.581093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee4ea-b39c-40fa-aa65-f29d8a51ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.581371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee4ea-b39c-40fa-aa65-f29d8a51ec3e None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.582126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee4ea-b39c-40fa-aa65-f29d8a51ec3e None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:13.582457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee4ea-b39c-40fa-aa65-f29d8a51ec3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.583826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee4ea-b39c-40fa-aa65-f29d8a51ec3e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.591994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 261/512] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:13.592808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee4ea-b39c-40fa-aa65-f29d8a51ec3e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.601691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929ce6-cd2c-4726-afb8-cd69b981a5f2 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.613043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.637785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010933-ed55-45e7-84c1-c2dcce420973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.638485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010933-ed55-45e7-84c1-c2dcce420973 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.638772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010933-ed55-45e7-84c1-c2dcce420973 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.639050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d010933-ed55-45e7-84c1-c2dcce420973 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.640013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d010933-ed55-45e7-84c1-c2dcce420973 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:13.640325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d010933-ed55-45e7-84c1-c2dcce420973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.641775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d010933-ed55-45e7-84c1-c2dcce420973 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.678713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 252/513] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:13.679464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010933-ed55-45e7-84c1-c2dcce420973 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.700366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee4ea-b39c-40fa-aa65-f29d8a51ec3e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.734660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcbfb-8b84-4670-922d-46c9d8915e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.735451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcbfb-8b84-4670-922d-46c9d8915e9a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.735811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcbfb-8b84-4670-922d-46c9d8915e9a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.736006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcbfb-8b84-4670-922d-46c9d8915e9a None admin] PATH_INFO: `/v3/users/glance` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.743910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bcbfb-8b84-4670-922d-46c9d8915e9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.745388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bcbfb-8b84-4670-922d-46c9d8915e9a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-c69bcbfb-8b84-4670-922d-46c9d8915e9a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:13.760913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:13.761998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:13.762966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 262/514] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:13.764102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcbfb-8b84-4670-922d-46c9d8915e9a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.788067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d010933-ed55-45e7-84c1-c2dcce420973 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.809353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.824829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779b929-65c4-42fb-949d-657aab93bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.825672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b929-65c4-42fb-949d-657aab93bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.825951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b929-65c4-42fb-949d-657aab93bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.826262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b929-65c4-42fb-949d-657aab93bcd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.834033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779b929-65c4-42fb-949d-657aab93bcd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.835648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779b929-65c4-42fb-949d-657aab93bcd6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-e779b929-65c4-42fb-949d-657aab93bcd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:13.851432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:13.852276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:13.853254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:13.853254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:13.853254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:13.853254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:13.853254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:13.853254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:13.853254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:13.853254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:13.853254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 253/515] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:13.854001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779b929-65c4-42fb-949d-657aab93bcd6 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.866086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcbfb-8b84-4670-922d-46c9d8915e9a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:13.882403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:13.900067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1e4a1-a19a-48bb-9f50-3ae23d78d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:13.900733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1e4a1-a19a-48bb-9f50-3ae23d78d16b None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:13.901017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1e4a1-a19a-48bb-9f50-3ae23d78d16b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:13.901287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1e4a1-a19a-48bb-9f50-3ae23d78d16b None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:13.901972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1e4a1-a19a-48bb-9f50-3ae23d78d16b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:13.903418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1e4a1-a19a-48bb-9f50-3ae23d78d16b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:13.923320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 263/516] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:13 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:13.924170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1e4a1-a19a-48bb-9f50-3ae23d78d16b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:13.963631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779b929-65c4-42fb-949d-657aab93bcd6 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.012293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7228c6b-4f92-4bae-8b85-3227ca72e7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.013186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7228c6b-4f92-4bae-8b85-3227ca72e7a0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.013496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7228c6b-4f92-4bae-8b85-3227ca72e7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.013771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7228c6b-4f92-4bae-8b85-3227ca72e7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.028478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7228c6b-4f92-4bae-8b85-3227ca72e7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.030079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7228c6b-4f92-4bae-8b85-3227ca72e7a0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-d7228c6b-4f92-4bae-8b85-3227ca72e7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:14.050055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:14.051407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:14.052324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:14.052324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:14.052324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:14.052324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:14.052324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 254/517] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:14.052324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7228c6b-4f92-4bae-8b85-3227ca72e7a0 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.057130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.062119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1e4a1-a19a-48bb-9f50-3ae23d78d16b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.107962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bd99e-db6c-4681-ac9b-4c1e2bb75d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.108744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bd99e-db6c-4681-ac9b-4c1e2bb75d6d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.109028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bd99e-db6c-4681-ac9b-4c1e2bb75d6d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.109601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bd99e-db6c-4681-ac9b-4c1e2bb75d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.159524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.182788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7228c6b-4f92-4bae-8b85-3227ca72e7a0 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.199894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bd99e-db6c-4681-ac9b-4c1e2bb75d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.201680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bd99e-db6c-4681-ac9b-4c1e2bb75d6d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.220233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd77a12-44ff-4858-ac5a-4a2da76fb367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.220850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd77a12-44ff-4858-ac5a-4a2da76fb367 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.221147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd77a12-44ff-4858-ac5a-4a2da76fb367 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.221407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd77a12-44ff-4858-ac5a-4a2da76fb367 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.222255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd77a12-44ff-4858-ac5a-4a2da76fb367 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:14.222588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd77a12-44ff-4858-ac5a-4a2da76fb367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.224049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd77a12-44ff-4858-ac5a-4a2da76fb367 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.247351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 255/518] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:14.247351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd77a12-44ff-4858-ac5a-4a2da76fb367 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.307144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.312221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 264/519] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:14.313414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bd99e-db6c-4681-ac9b-4c1e2bb75d6d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.353264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd77a12-44ff-4858-ac5a-4a2da76fb367 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.389403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15c1c-08f0-48c9-bd94-0a009cff426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.390069 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15c1c-08f0-48c9-bd94-0a009cff426a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.390348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15c1c-08f0-48c9-bd94-0a009cff426a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.390651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15c1c-08f0-48c9-bd94-0a009cff426a None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.391437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db15c1c-08f0-48c9-bd94-0a009cff426a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:14.391744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db15c1c-08f0-48c9-bd94-0a009cff426a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.393251 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db15c1c-08f0-48c9-bd94-0a009cff426a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.404072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.412187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 256/520] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:14.412905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15c1c-08f0-48c9-bd94-0a009cff426a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.427211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bd99e-db6c-4681-ac9b-4c1e2bb75d6d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.463917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869b22c-c335-4f46-8ba1-9b2e26347112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.464580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869b22c-c335-4f46-8ba1-9b2e26347112 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.464869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869b22c-c335-4f46-8ba1-9b2e26347112 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.465145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869b22c-c335-4f46-8ba1-9b2e26347112 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.465869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869b22c-c335-4f46-8ba1-9b2e26347112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:14.466177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869b22c-c335-4f46-8ba1-9b2e26347112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.467676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869b22c-c335-4f46-8ba1-9b2e26347112 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.480377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 265/521] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:14.481427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869b22c-c335-4f46-8ba1-9b2e26347112 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.529260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15c1c-08f0-48c9-bd94-0a009cff426a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.553531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.573279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e87ce-dde0-4653-ad5f-6749aef822f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.573991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e87ce-dde0-4653-ad5f-6749aef822f4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.574693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e87ce-dde0-4653-ad5f-6749aef822f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.574693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e87ce-dde0-4653-ad5f-6749aef822f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.606810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869b22c-c335-4f46-8ba1-9b2e26347112 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.645410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ec20d-a380-4d17-8c75-3032055a59cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.646324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ec20d-a380-4d17-8c75-3032055a59cf None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.646637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ec20d-a380-4d17-8c75-3032055a59cf None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.646914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ec20d-a380-4d17-8c75-3032055a59cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.649782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.657175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e87ce-dde0-4653-ad5f-6749aef822f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.659286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e87ce-dde0-4653-ad5f-6749aef822f4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.662252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ec20d-a380-4d17-8c75-3032055a59cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.663722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ec20d-a380-4d17-8c75-3032055a59cf None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e56ec20d-a380-4d17-8c75-3032055a59cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:14.681997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:14.683183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:14.684102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:14.684102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:14.684102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:14.684102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:14.688073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 266/522] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:14.688987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ec20d-a380-4d17-8c75-3032055a59cf None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.780175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 257/523] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:14.780945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e87ce-dde0-4653-ad5f-6749aef822f4 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.810276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ec20d-a380-4d17-8c75-3032055a59cf None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.826179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.852953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cee5e-6609-4cb3-abce-fdadef3663bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.853612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cee5e-6609-4cb3-abce-fdadef3663bb None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.853959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cee5e-6609-4cb3-abce-fdadef3663bb None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.854246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cee5e-6609-4cb3-abce-fdadef3663bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.855119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cee5e-6609-4cb3-abce-fdadef3663bb None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6cba70fa423e413a9222021116ff5718) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:14.855432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cee5e-6609-4cb3-abce-fdadef3663bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.856858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cee5e-6609-4cb3-abce-fdadef3663bb None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:14.863544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 267/524] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/role_assignments?user.id=6cba70fa423e413a9222021116ff5718&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:14.864124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cee5e-6609-4cb3-abce-fdadef3663bb None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:14.909826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:14.919722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e87ce-dde0-4653-ad5f-6749aef822f4 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:14.974592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b310e-0994-4c3e-a4d8-8b38d3515d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:14.975833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b310e-0994-4c3e-a4d8-8b38d3515d37 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:14.976535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b310e-0994-4c3e-a4d8-8b38d3515d37 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:14.977026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b310e-0994-4c3e-a4d8-8b38d3515d37 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:14.989413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b310e-0994-4c3e-a4d8-8b38d3515d37 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:14.991543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b310e-0994-4c3e-a4d8-8b38d3515d37 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.009457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cee5e-6609-4cb3-abce-fdadef3663bb None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-7f1b310e-0994-4c3e-a4d8-8b38d3515d37 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:15.010662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:15.011520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:15.012417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:15.015568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 258/525] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:15.016692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b310e-0994-4c3e-a4d8-8b38d3515d37 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.061378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d573-ffe1-4723-9f39-46bc3532e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.062048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d573-ffe1-4723-9f39-46bc3532e34b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.062331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d573-ffe1-4723-9f39-46bc3532e34b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.062680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d573-ffe1-4723-9f39-46bc3532e34b None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.063387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056d573-ffe1-4723-9f39-46bc3532e34b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:15.063699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056d573-ffe1-4723-9f39-46bc3532e34b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.066538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056d573-ffe1-4723-9f39-46bc3532e34b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.090610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 268/526] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:15.094442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d573-ffe1-4723-9f39-46bc3532e34b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.173234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.181118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b310e-0994-4c3e-a4d8-8b38d3515d37 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.223210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c0e70-1bad-4a49-9011-ad936132e872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.224526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c0e70-1bad-4a49-9011-ad936132e872 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.225054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c0e70-1bad-4a49-9011-ad936132e872 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.225515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c0e70-1bad-4a49-9011-ad936132e872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.238252 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c0e70-1bad-4a49-9011-ad936132e872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.240442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c0e70-1bad-4a49-9011-ad936132e872 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.248286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d573-ffe1-4723-9f39-46bc3532e34b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-eb1c0e70-1bad-4a49-9011-ad936132e872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:15.261736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:15.263017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:15.263931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:15.263931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:15.263931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:15.263931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:15.271167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 259/527] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:15.272567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c0e70-1bad-4a49-9011-ad936132e872 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.287641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.289535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41e164-30e0-43f4-8288-a9ec3c6fcc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.290600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41e164-30e0-43f4-8288-a9ec3c6fcc56 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.291370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41e164-30e0-43f4-8288-a9ec3c6fcc56 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.292216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41e164-30e0-43f4-8288-a9ec3c6fcc56 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.293208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41e164-30e0-43f4-8288-a9ec3c6fcc56 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:15.293684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41e164-30e0-43f4-8288-a9ec3c6fcc56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.295416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41e164-30e0-43f4-8288-a9ec3c6fcc56 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.315647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 269/528] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:15.316793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41e164-30e0-43f4-8288-a9ec3c6fcc56 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.397609 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c0e70-1bad-4a49-9011-ad936132e872 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.428403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.437576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41e164-30e0-43f4-8288-a9ec3c6fcc56 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.441916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1b505-d5db-443d-bcb1-df251d1acd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.442939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1b505-d5db-443d-bcb1-df251d1acd6b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.443368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1b505-d5db-443d-bcb1-df251d1acd6b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.443813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1b505-d5db-443d-bcb1-df251d1acd6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.452842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1b505-d5db-443d-bcb1-df251d1acd6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.454808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1b505-d5db-443d-bcb1-df251d1acd6b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-74f1b505-d5db-443d-bcb1-df251d1acd6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:15.474684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:15.475601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:15.476417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:15.476417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:15.476417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:15.476417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:15.476417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:15.476417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:15.476417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:15.476417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:15.479195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 260/529] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:15.480147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1b505-d5db-443d-bcb1-df251d1acd6b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.486840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c11f0-4e28-48f9-8ca9-65cd3be1fbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.487645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c11f0-4e28-48f9-8ca9-65cd3be1fbec None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.488029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c11f0-4e28-48f9-8ca9-65cd3be1fbec None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.488404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c11f0-4e28-48f9-8ca9-65cd3be1fbec None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.489234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c11f0-4e28-48f9-8ca9-65cd3be1fbec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:15.489677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c11f0-4e28-48f9-8ca9-65cd3be1fbec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.491307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c11f0-4e28-48f9-8ca9-65cd3be1fbec None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.509718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 270/530] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:15.515055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c11f0-4e28-48f9-8ca9-65cd3be1fbec None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.578012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.622080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1b505-d5db-443d-bcb1-df251d1acd6b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.635133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c11f0-4e28-48f9-8ca9-65cd3be1fbec None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.675036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cde61-e5e9-48d6-9f51-24c0ee34fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.675690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cde61-e5e9-48d6-9f51-24c0ee34fa69 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.675975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cde61-e5e9-48d6-9f51-24c0ee34fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.676252 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cde61-e5e9-48d6-9f51-24c0ee34fa69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.679541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08d0a9-41d3-4f83-ba71-7bc2f4fe8933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.680193 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08d0a9-41d3-4f83-ba71-7bc2f4fe8933 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.680477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08d0a9-41d3-4f83-ba71-7bc2f4fe8933 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.680759 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08d0a9-41d3-4f83-ba71-7bc2f4fe8933 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.682245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08d0a9-41d3-4f83-ba71-7bc2f4fe8933 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:15.682245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08d0a9-41d3-4f83-ba71-7bc2f4fe8933 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.683311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08d0a9-41d3-4f83-ba71-7bc2f4fe8933 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.707768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 271/531] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:15.707768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08d0a9-41d3-4f83-ba71-7bc2f4fe8933 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.729924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.774191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cde61-e5e9-48d6-9f51-24c0ee34fa69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.776558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cde61-e5e9-48d6-9f51-24c0ee34fa69 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.827545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08d0a9-41d3-4f83-ba71-7bc2f4fe8933 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:15.861320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.863546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd57f8-2fe8-4448-8994-93a8c538f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:15.865031 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd57f8-2fe8-4448-8994-93a8c538f3fe None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:15.865031 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd57f8-2fe8-4448-8994-93a8c538f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:15.865289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd57f8-2fe8-4448-8994-93a8c538f3fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:15.872719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd57f8-2fe8-4448-8994-93a8c538f3fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:15.874289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd57f8-2fe8-4448-8994-93a8c538f3fe None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-67cd57f8-2fe8-4448-8994-93a8c538f3fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:15.889615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:15.890550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:15.891388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:15.891388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:15.891388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:15.891388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:15.891388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:15.891388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:15.891388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:15.891388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:15.891388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 272/532] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:15.891846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd57f8-2fe8-4448-8994-93a8c538f3fe None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.908390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 261/533] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:15.909748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cde61-e5e9-48d6-9f51-24c0ee34fa69 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:15.970256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:15.998649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd57f8-2fe8-4448-8994-93a8c538f3fe None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.034219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cde61-e5e9-48d6-9f51-24c0ee34fa69 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.036055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dadfe1-5ef9-441e-b65d-d33e2b908e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.036779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dadfe1-5ef9-441e-b65d-d33e2b908e88 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.037128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dadfe1-5ef9-441e-b65d-d33e2b908e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.037476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dadfe1-5ef9-441e-b65d-d33e2b908e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.038849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dadfe1-5ef9-441e-b65d-d33e2b908e88 None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=387fd99ff326463698bc32947ba25d77) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:16.038849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dadfe1-5ef9-441e-b65d-d33e2b908e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.040265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dadfe1-5ef9-441e-b65d-d33e2b908e88 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.051465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 273/534] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/role_assignments?user.id=387fd99ff326463698bc32947ba25d77&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:16.051465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dadfe1-5ef9-441e-b65d-d33e2b908e88 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.107819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bc138-d06f-413f-87c6-84d6e2136909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.108862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bc138-d06f-413f-87c6-84d6e2136909 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.109142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bc138-d06f-413f-87c6-84d6e2136909 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.109414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bc138-d06f-413f-87c6-84d6e2136909 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.110229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bc138-d06f-413f-87c6-84d6e2136909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:16.110567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bc138-d06f-413f-87c6-84d6e2136909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.112191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bc138-d06f-413f-87c6-84d6e2136909 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.131526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 262/535] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:16.138359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bc138-d06f-413f-87c6-84d6e2136909 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.183403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.203501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dadfe1-5ef9-441e-b65d-d33e2b908e88 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.242180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fbe44-a355-470e-ada2-2f3cc47201cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.243041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fbe44-a355-470e-ada2-2f3cc47201cf None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.243320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fbe44-a355-470e-ada2-2f3cc47201cf None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.243591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fbe44-a355-470e-ada2-2f3cc47201cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.251083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.256721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fbe44-a355-470e-ada2-2f3cc47201cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.258739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fbe44-a355-470e-ada2-2f3cc47201cf None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.275039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bc138-d06f-413f-87c6-84d6e2136909 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-784fbe44-a355-470e-ada2-2f3cc47201cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:16.278317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:16.279248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:16.280092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:16.280092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:16.280092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:16.280092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:16.280092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 274/536] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:16.285562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9924-0a4d-4237-9d2a-edcf4da99d5c None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.285912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9924-0a4d-4237-9d2a-edcf4da99d5c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.286259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9924-0a4d-4237-9d2a-edcf4da99d5c None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.288041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 275/537] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:16.288709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c9924-0a4d-4237-9d2a-edcf4da99d5c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.319632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c8b44-2769-4214-a899-1d2f2ad317c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.320701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c8b44-2769-4214-a899-1d2f2ad317c6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.321094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c8b44-2769-4214-a899-1d2f2ad317c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.321470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c8b44-2769-4214-a899-1d2f2ad317c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.322455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c8b44-2769-4214-a899-1d2f2ad317c6 None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=beb359ac9b084b38b77923219f42f655) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:16.322876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c8b44-2769-4214-a899-1d2f2ad317c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.324411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c8b44-2769-4214-a899-1d2f2ad317c6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.331397 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 263/538] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/role_assignments?user.id=beb359ac9b084b38b77923219f42f655&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:16.332799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e16b3f-2115-42d1-8be6-07e3794e5a72 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.333160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e16b3f-2115-42d1-8be6-07e3794e5a72 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.333527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e16b3f-2115-42d1-8be6-07e3794e5a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.351108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-16e16b3f-2115-42d1-8be6-07e3794e5a72 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:16.352432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-16e16b3f-2115-42d1-8be6-07e3794e5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:16.465651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c9924-0a4d-4237-9d2a-edcf4da99d5c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.475398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 264/539] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:16.511945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e16b3f-2115-42d1-8be6-07e3794e5a72 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.524806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403d41a-3b66-4d5b-80fb-db2c877b82bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.525495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403d41a-3b66-4d5b-80fb-db2c877b82bd None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.525781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403d41a-3b66-4d5b-80fb-db2c877b82bd None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.526059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403d41a-3b66-4d5b-80fb-db2c877b82bd None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.526813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403d41a-3b66-4d5b-80fb-db2c877b82bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:16.527132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403d41a-3b66-4d5b-80fb-db2c877b82bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.528626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403d41a-3b66-4d5b-80fb-db2c877b82bd None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.543697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.553276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 276/540] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:16.558737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403d41a-3b66-4d5b-80fb-db2c877b82bd None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.618141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.636811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e16b3f-2115-42d1-8be6-07e3794e5a72 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.672590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f897669-506a-4dd5-9ce8-33d5e7d4a160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.673758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f897669-506a-4dd5-9ce8-33d5e7d4a160 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.674797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f897669-506a-4dd5-9ce8-33d5e7d4a160 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.675286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f897669-506a-4dd5-9ce8-33d5e7d4a160 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.677106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403d41a-3b66-4d5b-80fb-db2c877b82bd None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.686702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f897669-506a-4dd5-9ce8-33d5e7d4a160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-3f897669-506a-4dd5-9ce8-33d5e7d4a160 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:16.695205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:16.696101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:16.696878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:16.699549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 265/541] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:16.705793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f897669-506a-4dd5-9ce8-33d5e7d4a160 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.730620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ae25-5709-46f8-9391-9d819afe75eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.731749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ae25-5709-46f8-9391-9d819afe75eb None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.732361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ae25-5709-46f8-9391-9d819afe75eb None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.732892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ae25-5709-46f8-9391-9d819afe75eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.741690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ae25-5709-46f8-9391-9d819afe75eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.743436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ae25-5709-46f8-9391-9d819afe75eb None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-da49ae25-5709-46f8-9391-9d819afe75eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:16.761220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:16.762095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:16.762951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:16.762951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:16.762951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:16.762951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:16.762951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:16.762951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:16.762951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:16.762951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:16.765624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 277/542] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:16.774769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ae25-5709-46f8-9391-9d819afe75eb None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.914888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ae25-5709-46f8-9391-9d819afe75eb None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:16.932247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.950864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.955644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e1571-6ff9-4514-abfc-0c1a11235adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:16.956608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e1571-6ff9-4514-abfc-0c1a11235adc None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:16.957085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e1571-6ff9-4514-abfc-0c1a11235adc None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:16.957568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e1571-6ff9-4514-abfc-0c1a11235adc None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:16.959048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e1571-6ff9-4514-abfc-0c1a11235adc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:16.959563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e1571-6ff9-4514-abfc-0c1a11235adc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:16.961188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e1571-6ff9-4514-abfc-0c1a11235adc None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:16.975787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 278/543] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:16.980829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e1571-6ff9-4514-abfc-0c1a11235adc None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:16.992200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f897669-506a-4dd5-9ce8-33d5e7d4a160 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.057771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde273d8-f1ae-4527-9476-ec8ee645a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.058460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde273d8-f1ae-4527-9476-ec8ee645a010 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.058756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde273d8-f1ae-4527-9476-ec8ee645a010 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.059035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde273d8-f1ae-4527-9476-ec8ee645a010 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.060060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde273d8-f1ae-4527-9476-ec8ee645a010 None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:17.060369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde273d8-f1ae-4527-9476-ec8ee645a010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.061743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde273d8-f1ae-4527-9476-ec8ee645a010 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.092777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 266/544] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:17.103467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde273d8-f1ae-4527-9476-ec8ee645a010 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.104040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e1571-6ff9-4514-abfc-0c1a11235adc None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.142838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a072f-6878-44f2-80fb-e4901ab33363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.144480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a072f-6878-44f2-80fb-e4901ab33363 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.144969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a072f-6878-44f2-80fb-e4901ab33363 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.145662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a072f-6878-44f2-80fb-e4901ab33363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.146991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a072f-6878-44f2-80fb-e4901ab33363 None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=e11a8567e1254a0080cbe74efe0127f5) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:17.147509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a072f-6878-44f2-80fb-e4901ab33363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.149566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a072f-6878-44f2-80fb-e4901ab33363 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.157002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 279/545] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:16 2022] GET /identity/v3/role_assignments?user.id=e11a8567e1254a0080cbe74efe0127f5&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:17.259486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde273d8-f1ae-4527-9476-ec8ee645a010 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.306151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb930-232b-415b-be26-d81599e87882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.306984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb930-232b-415b-be26-d81599e87882 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.307267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb930-232b-415b-be26-d81599e87882 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.307541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb930-232b-415b-be26-d81599e87882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.323036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fb930-232b-415b-be26-d81599e87882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.324878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fb930-232b-415b-be26-d81599e87882 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.339969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-0e2fb930-232b-415b-be26-d81599e87882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:17.366122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:17.367044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:17.367889 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:17.367889 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:17.367889 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:17.367889 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:17.368578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 267/546] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:17.375042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a072f-6878-44f2-80fb-e4901ab33363 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.442792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.525440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a072f-6878-44f2-80fb-e4901ab33363 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.560867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef815e-2e34-4e47-841d-b149c93f1a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.561691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef815e-2e34-4e47-841d-b149c93f1a4a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.562069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef815e-2e34-4e47-841d-b149c93f1a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.562470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef815e-2e34-4e47-841d-b149c93f1a4a None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.563308 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef815e-2e34-4e47-841d-b149c93f1a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:17.563721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef815e-2e34-4e47-841d-b149c93f1a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.567611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef815e-2e34-4e47-841d-b149c93f1a4a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.580702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 280/547] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:17.585886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb930-232b-415b-be26-d81599e87882 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.722197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd6210-2d8d-485d-b742-960a9e936c3b None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.722606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd6210-2d8d-485d-b742-960a9e936c3b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.722904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd6210-2d8d-485d-b742-960a9e936c3b None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.724498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 281/548] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:17.729649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a48048-8fa1-4ca5-b62a-7d27099f91f2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.729935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a48048-8fa1-4ca5-b62a-7d27099f91f2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.730221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a48048-8fa1-4ca5-b62a-7d27099f91f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.735409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb930-232b-415b-be26-d81599e87882 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.748027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e7a48048-8fa1-4ca5-b62a-7d27099f91f2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:17.749214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e7a48048-8fa1-4ca5-b62a-7d27099f91f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:17.780030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530478b1-244d-46be-bd39-745125be1859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:17.780757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530478b1-244d-46be-bd39-745125be1859 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:17.781038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530478b1-244d-46be-bd39-745125be1859 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:17.781310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530478b1-244d-46be-bd39-745125be1859 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:17.792053 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530478b1-244d-46be-bd39-745125be1859 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:17.794178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530478b1-244d-46be-bd39-745125be1859 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-530478b1-244d-46be-bd39-745125be1859 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:17.809194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:17.811813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:17.812871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 268/549] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:17.820038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530478b1-244d-46be-bd39-745125be1859 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.860116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 282/550] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:17.909882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a48048-8fa1-4ca5-b62a-7d27099f91f2 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:17.914779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:17.963726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530478b1-244d-46be-bd39-745125be1859 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:17.978743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.005551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385d0b-1222-4791-8021-403aaefb90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.006541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385d0b-1222-4791-8021-403aaefb90cc None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.007015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385d0b-1222-4791-8021-403aaefb90cc None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.007468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385d0b-1222-4791-8021-403aaefb90cc None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.008581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385d0b-1222-4791-8021-403aaefb90cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:18.009077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385d0b-1222-4791-8021-403aaefb90cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.010720 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98385d0b-1222-4791-8021-403aaefb90cc None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.030123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 269/551] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:18.035829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385d0b-1222-4791-8021-403aaefb90cc None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.072343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a48048-8fa1-4ca5-b62a-7d27099f91f2 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.114700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df880591-a126-4915-8175-a8a644411138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.115739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df880591-a126-4915-8175-a8a644411138 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.116092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df880591-a126-4915-8175-a8a644411138 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.116443 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df880591-a126-4915-8175-a8a644411138 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.134407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df880591-a126-4915-8175-a8a644411138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-df880591-a126-4915-8175-a8a644411138 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:18.138497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:18.139366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:18.140367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 283/552] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:18.146691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df880591-a126-4915-8175-a8a644411138 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.244148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.262572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df880591-a126-4915-8175-a8a644411138 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.300742 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c1157-d065-4596-a023-f4d48058418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.301358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c1157-d065-4596-a023-f4d48058418c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.301641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c1157-d065-4596-a023-f4d48058418c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.301919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c1157-d065-4596-a023-f4d48058418c None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.302706 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c1157-d065-4596-a023-f4d48058418c None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:18.303017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c1157-d065-4596-a023-f4d48058418c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.304408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c1157-d065-4596-a023-f4d48058418c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.318737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 284/553] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:18.320591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c1157-d065-4596-a023-f4d48058418c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.327048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385d0b-1222-4791-8021-403aaefb90cc None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.378748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.442969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c1157-d065-4596-a023-f4d48058418c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.450183 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a909c89-7dd2-4a7f-b5b3-d6148b17271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.451282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a909c89-7dd2-4a7f-b5b3-d6148b17271d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.451771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a909c89-7dd2-4a7f-b5b3-d6148b17271d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.452289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a909c89-7dd2-4a7f-b5b3-d6148b17271d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.490689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02357e0d-4926-4cbe-8737-5765dc89112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.491859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02357e0d-4926-4cbe-8737-5765dc89112c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.492159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02357e0d-4926-4cbe-8737-5765dc89112c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.492437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02357e0d-4926-4cbe-8737-5765dc89112c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.523682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02357e0d-4926-4cbe-8737-5765dc89112c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.526010 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02357e0d-4926-4cbe-8737-5765dc89112c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.535784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-02357e0d-4926-4cbe-8737-5765dc89112c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:18.552040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:18.553022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:18.553867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:18.553867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:18.553867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:18.553867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:18.558793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 285/554] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:18.561433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbead-3bd5-442e-906a-f079102d0ece None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.561901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbead-3bd5-442e-906a-f079102d0ece None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.562181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbead-3bd5-442e-906a-f079102d0ece None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.564816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 286/555] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:18.566917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fbead-3bd5-442e-906a-f079102d0ece None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.582923 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a909c89-7dd2-4a7f-b5b3-d6148b17271d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.583788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a909c89-7dd2-4a7f-b5b3-d6148b17271d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.705426 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 270/556] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:18.707747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd513c58-cffd-42fa-ae68-84a70f9b8379 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.708332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd513c58-cffd-42fa-ae68-84a70f9b8379 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.708754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd513c58-cffd-42fa-ae68-84a70f9b8379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.722872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fbead-3bd5-442e-906a-f079102d0ece None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.728990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-bd513c58-cffd-42fa-ae68-84a70f9b8379 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:18.730546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-bd513c58-cffd-42fa-ae68-84a70f9b8379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:18.745378 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.775044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf515a-89e3-4b4c-8aa4-451a5fc91b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.775821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf515a-89e3-4b4c-8aa4-451a5fc91b7c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.776106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf515a-89e3-4b4c-8aa4-451a5fc91b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.776385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf515a-89e3-4b4c-8aa4-451a5fc91b7c None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:18.777113 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf515a-89e3-4b4c-8aa4-451a5fc91b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:18.777426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf515a-89e3-4b4c-8aa4-451a5fc91b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:18.778833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf515a-89e3-4b4c-8aa4-451a5fc91b7c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:18.795892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 287/557] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:18.796914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf515a-89e3-4b4c-8aa4-451a5fc91b7c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.834762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 271/558] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:18.835716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd513c58-cffd-42fa-ae68-84a70f9b8379 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:18.876202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.943187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf515a-89e3-4b4c-8aa4-451a5fc91b7c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.971061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd513c58-cffd-42fa-ae68-84a70f9b8379 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:18.988615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ee95-4811-42c0-be51-d81e978da21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:18.990333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ee95-4811-42c0-be51-d81e978da21a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:18.991105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ee95-4811-42c0-be51-d81e978da21a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:18.991557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ee95-4811-42c0-be51-d81e978da21a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.007372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ee95-4811-42c0-be51-d81e978da21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:19.009230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ee95-4811-42c0-be51-d81e978da21a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:19.009730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da649f9-03e7-4fe3-89af-2b2abe336a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.010644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da649f9-03e7-4fe3-89af-2b2abe336a04 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.011025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da649f9-03e7-4fe3-89af-2b2abe336a04 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.011350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da649f9-03e7-4fe3-89af-2b2abe336a04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.020902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da649f9-03e7-4fe3-89af-2b2abe336a04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:19.022352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da649f9-03e7-4fe3-89af-2b2abe336a04 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-57f2ee95-4811-42c0-be51-d81e978da21a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:19.038407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:19.039305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:19.040161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:19.040161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:19.040161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:19.040161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-8da649f9-03e7-4fe3-89af-2b2abe336a04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:19.040386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:19.041279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:19.043246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:19.044526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 288/559] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:19.044526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ee95-4811-42c0-be51-d81e978da21a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.044787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 272/560] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:19.044787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da649f9-03e7-4fe3-89af-2b2abe336a04 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.055729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:19.163297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da649f9-03e7-4fe3-89af-2b2abe336a04 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:19.165833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ee95-4811-42c0-be51-d81e978da21a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:19.179236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:19.197330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbc0e9-59a7-4a5d-b5c8-509fc5103fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.198023 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbc0e9-59a7-4a5d-b5c8-509fc5103fd7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.198283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbc0e9-59a7-4a5d-b5c8-509fc5103fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.198619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbc0e9-59a7-4a5d-b5c8-509fc5103fd7 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.199458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbc0e9-59a7-4a5d-b5c8-509fc5103fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:19.199768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbc0e9-59a7-4a5d-b5c8-509fc5103fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:19.201192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbc0e9-59a7-4a5d-b5c8-509fc5103fd7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:19.205005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58496dec-d1d3-4de5-a79e-cd7927062f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.206326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496dec-d1d3-4de5-a79e-cd7927062f14 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.206636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496dec-d1d3-4de5-a79e-cd7927062f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.206911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58496dec-d1d3-4de5-a79e-cd7927062f14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.217788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58496dec-d1d3-4de5-a79e-cd7927062f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:19.224171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 273/561] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:19.224171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbc0e9-59a7-4a5d-b5c8-509fc5103fd7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-58496dec-d1d3-4de5-a79e-cd7927062f14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:19.226312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:19.227404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:19.228334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 289/562] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:19.229000 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c73b55-03cc-48b2-b720-ff1618d3869d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.229066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c73b55-03cc-48b2-b720-ff1618d3869d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.229323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c73b55-03cc-48b2-b720-ff1618d3869d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.230929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 290/563] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:19.234727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c73b55-03cc-48b2-b720-ff1618d3869d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.307918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:19.350874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbc0e9-59a7-4a5d-b5c8-509fc5103fd7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:19.353461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c73b55-03cc-48b2-b720-ff1618d3869d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:19.386631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816ef2-4eea-47cc-920a-9b493d42b3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.387440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816ef2-4eea-47cc-920a-9b493d42b3cc None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.387847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816ef2-4eea-47cc-920a-9b493d42b3cc None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.388209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816ef2-4eea-47cc-920a-9b493d42b3cc None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.389030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8816ef2-4eea-47cc-920a-9b493d42b3cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:19.389442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8816ef2-4eea-47cc-920a-9b493d42b3cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:19.390330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf134b-886d-4efc-ae98-cc39fb56383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.391113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8816ef2-4eea-47cc-920a-9b493d42b3cc None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:19.391213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf134b-886d-4efc-ae98-cc39fb56383c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.391425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf134b-886d-4efc-ae98-cc39fb56383c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.391699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf134b-886d-4efc-ae98-cc39fb56383c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.403162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf134b-886d-4efc-ae98-cc39fb56383c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:19.408642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 274/564] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:19.408801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf134b-886d-4efc-ae98-cc39fb56383c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:19.408915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816ef2-4eea-47cc-920a-9b493d42b3cc None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-deaf134b-886d-4efc-ae98-cc39fb56383c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:19.425696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:19.426799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:19.427820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:19.427820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:19.427820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:19.427820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:19.428309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 291/565] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:19.429750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4528c-4bec-4d25-89c0-c4e191da6c64 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.430096 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4528c-4bec-4d25-89c0-c4e191da6c64 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.430603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4528c-4bec-4d25-89c0-c4e191da6c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.448400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-8fc4528c-4bec-4d25-89c0-c4e191da6c64 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:19.449569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8fc4528c-4bec-4d25-89c0-c4e191da6c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:19.467350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:19.521803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816ef2-4eea-47cc-920a-9b493d42b3cc None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:19.529468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 292/566] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:19.530283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4528c-4bec-4d25-89c0-c4e191da6c64 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.566898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:19.578347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f08cf4-511d-4968-ab80-561f4ff1c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.579038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08cf4-511d-4968-ab80-561f4ff1c13b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.579320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08cf4-511d-4968-ab80-561f4ff1c13b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.579596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08cf4-511d-4968-ab80-561f4ff1c13b None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.580340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08cf4-511d-4968-ab80-561f4ff1c13b None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:19.581214 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08cf4-511d-4968-ab80-561f4ff1c13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:19.582606 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08cf4-511d-4968-ab80-561f4ff1c13b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:19.591645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 275/567] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:19.592239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f08cf4-511d-4968-ab80-561f4ff1c13b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.654188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4528c-4bec-4d25-89c0-c4e191da6c64 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:19.693341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a319dca-8df5-41fa-a413-8605fbf7b95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.694496 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a319dca-8df5-41fa-a413-8605fbf7b95d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.695036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a319dca-8df5-41fa-a413-8605fbf7b95d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.695312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a319dca-8df5-41fa-a413-8605fbf7b95d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.699422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f08cf4-511d-4968-ab80-561f4ff1c13b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:19.704214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a319dca-8df5-41fa-a413-8605fbf7b95d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:19.705691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a319dca-8df5-41fa-a413-8605fbf7b95d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-4a319dca-8df5-41fa-a413-8605fbf7b95d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:19.724041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:19.725033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:19.725929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:19.725929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:19.725929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:19.725929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:19.725929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:19.725929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:19.725929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:19.725929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:19.726351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 293/568] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:19.726982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a319dca-8df5-41fa-a413-8605fbf7b95d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.740631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde2d5-c924-43a8-9bc6-23d651011a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.741334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde2d5-c924-43a8-9bc6-23d651011a9f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.741621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde2d5-c924-43a8-9bc6-23d651011a9f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.741902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde2d5-c924-43a8-9bc6-23d651011a9f None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.742692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdde2d5-c924-43a8-9bc6-23d651011a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:19.743004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdde2d5-c924-43a8-9bc6-23d651011a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:19.744448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdde2d5-c924-43a8-9bc6-23d651011a9f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:19.747239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:19.763256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 276/569] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:19.763256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde2d5-c924-43a8-9bc6-23d651011a9f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.810326 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:19.847771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a319dca-8df5-41fa-a413-8605fbf7b95d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:19.871009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde2d5-c924-43a8-9bc6-23d651011a9f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:19.881753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a742376-fabf-4cc8-82d9-c822e637979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.882569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a742376-fabf-4cc8-82d9-c822e637979b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.882852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a742376-fabf-4cc8-82d9-c822e637979b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.883127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a742376-fabf-4cc8-82d9-c822e637979b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.893396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a742376-fabf-4cc8-82d9-c822e637979b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-3a742376-fabf-4cc8-82d9-c822e637979b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:19.901147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:19.902252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 294/570] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:19.903167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a742376-fabf-4cc8-82d9-c822e637979b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.906745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b111f1-f72c-4393-8477-dc63108d3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:19.907534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b111f1-f72c-4393-8477-dc63108d3a2f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:19.907813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b111f1-f72c-4393-8477-dc63108d3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:19.908084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b111f1-f72c-4393-8477-dc63108d3a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:19.918254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b111f1-f72c-4393-8477-dc63108d3a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:19.919722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b111f1-f72c-4393-8477-dc63108d3a2f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-48b111f1-f72c-4393-8477-dc63108d3a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:19.937568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:19.938651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:19.940659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:19.940659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:19.940659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:19.940659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:19.940659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 277/571] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:19.940659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b111f1-f72c-4393-8477-dc63108d3a2f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:19.976612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:20.006577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a742376-fabf-4cc8-82d9-c822e637979b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.035907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:20.039819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a9781-27e9-4d41-8e83-ed05e1d2e7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.040152 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b111f1-f72c-4393-8477-dc63108d3a2f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.040485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a9781-27e9-4d41-8e83-ed05e1d2e7b1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.040770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a9781-27e9-4d41-8e83-ed05e1d2e7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.041049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a9781-27e9-4d41-8e83-ed05e1d2e7b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.041832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a9781-27e9-4d41-8e83-ed05e1d2e7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:20.042160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a9781-27e9-4d41-8e83-ed05e1d2e7b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.043622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a9781-27e9-4d41-8e83-ed05e1d2e7b1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.056734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 295/572] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:20.057997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb97d-9cfd-46fa-b504-3cee869efddf None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.058283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb97d-9cfd-46fa-b504-3cee869efddf None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.058598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bb97d-9cfd-46fa-b504-3cee869efddf None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.059814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 296/573] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:20.060754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb97d-9cfd-46fa-b504-3cee869efddf None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.079995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ba1f4-baf4-4e41-b5d3-64a2e7a28c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.080790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba1f4-baf4-4e41-b5d3-64a2e7a28c21 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.081074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba1f4-baf4-4e41-b5d3-64a2e7a28c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.081353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba1f4-baf4-4e41-b5d3-64a2e7a28c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.088135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ba1f4-baf4-4e41-b5d3-64a2e7a28c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.089574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ba1f4-baf4-4e41-b5d3-64a2e7a28c21 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-478ba1f4-baf4-4e41-b5d3-64a2e7a28c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:20.103844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:20.104907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:20.105828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:20.105828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:20.105828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:20.105828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:20.105828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:20.105828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:20.105828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:20.105828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:20.105828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 278/574] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:20.106313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ba1f4-baf4-4e41-b5d3-64a2e7a28c21 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.170571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bb97d-9cfd-46fa-b504-3cee869efddf None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.200957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:20.205844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ba1f4-baf4-4e41-b5d3-64a2e7a28c21 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.206866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea94fd-8c3c-40d7-84a6-67e0a4cd3707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.207552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea94fd-8c3c-40d7-84a6-67e0a4cd3707 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.207833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea94fd-8c3c-40d7-84a6-67e0a4cd3707 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.208112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea94fd-8c3c-40d7-84a6-67e0a4cd3707 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.208865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea94fd-8c3c-40d7-84a6-67e0a4cd3707 None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:20.209172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea94fd-8c3c-40d7-84a6-67e0a4cd3707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.210591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea94fd-8c3c-40d7-84a6-67e0a4cd3707 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.219435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 297/575] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:20.220284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea94fd-8c3c-40d7-84a6-67e0a4cd3707 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.241508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ab658-6253-4c2c-a321-09f575b38c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.242091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ab658-6253-4c2c-a321-09f575b38c9b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.242371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ab658-6253-4c2c-a321-09f575b38c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.242673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ab658-6253-4c2c-a321-09f575b38c9b None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.243393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ab658-6253-4c2c-a321-09f575b38c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:20.243905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ab658-6253-4c2c-a321-09f575b38c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.245058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ab658-6253-4c2c-a321-09f575b38c9b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.256591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 279/576] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:20.257771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e090cd-0dc7-4333-9e34-99667f199aaf None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.258054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e090cd-0dc7-4333-9e34-99667f199aaf None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.258328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e090cd-0dc7-4333-9e34-99667f199aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.274692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-26e090cd-0dc7-4333-9e34-99667f199aaf None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:20.275873 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-26e090cd-0dc7-4333-9e34-99667f199aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:20.289756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:20.327987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea94fd-8c3c-40d7-84a6-67e0a4cd3707 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.344915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 280/577] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:20.345750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e090cd-0dc7-4333-9e34-99667f199aaf None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.363616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ef79a-2f3f-42ad-ac70-ba7c513de73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.364269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ef79a-2f3f-42ad-ac70-ba7c513de73d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.364560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ef79a-2f3f-42ad-ac70-ba7c513de73d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.364836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ef79a-2f3f-42ad-ac70-ba7c513de73d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.365669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ef79a-2f3f-42ad-ac70-ba7c513de73d None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=f7da017f9a5b4bfcb5b97b5310e0a146) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:20.365986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ef79a-2f3f-42ad-ac70-ba7c513de73d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.367604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ef79a-2f3f-42ad-ac70-ba7c513de73d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.373321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 298/578] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/role_assignments?user.id=f7da017f9a5b4bfcb5b97b5310e0a146&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:20.374165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ef79a-2f3f-42ad-ac70-ba7c513de73d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.442627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:20.475636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e090cd-0dc7-4333-9e34-99667f199aaf None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.489533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ef79a-2f3f-42ad-ac70-ba7c513de73d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.519386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09d6a8-9eb6-45f6-8fe6-d20890e842ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.520149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09d6a8-9eb6-45f6-8fe6-d20890e842ae None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.520512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09d6a8-9eb6-45f6-8fe6-d20890e842ae None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.520860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09d6a8-9eb6-45f6-8fe6-d20890e842ae None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.521749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09d6a8-9eb6-45f6-8fe6-d20890e842ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:20.522169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09d6a8-9eb6-45f6-8fe6-d20890e842ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.523985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09d6a8-9eb6-45f6-8fe6-d20890e842ae None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.536060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b3a08-20ff-41be-bb57-c558468404f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.536863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b3a08-20ff-41be-bb57-c558468404f6 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.537157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b3a08-20ff-41be-bb57-c558468404f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.537432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b3a08-20ff-41be-bb57-c558468404f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.537662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 281/579] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:20.538695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09d6a8-9eb6-45f6-8fe6-d20890e842ae None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.550229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b3a08-20ff-41be-bb57-c558468404f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.550419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:20.551737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b3a08-20ff-41be-bb57-c558468404f6 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-514b3a08-20ff-41be-bb57-c558468404f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:20.578040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:20.579182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:20.580238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:20.580238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:20.580238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:20.580238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:20.580238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 299/580] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:20.580569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b3a08-20ff-41be-bb57-c558468404f6 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.657372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09d6a8-9eb6-45f6-8fe6-d20890e842ae None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.685919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b3a08-20ff-41be-bb57-c558468404f6 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.697035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:20.701734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1f2d9-1653-4c85-bda2-1723f39d5320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.702565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1f2d9-1653-4c85-bda2-1723f39d5320 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.702852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1f2d9-1653-4c85-bda2-1723f39d5320 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.703125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1f2d9-1653-4c85-bda2-1723f39d5320 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.712172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1f2d9-1653-4c85-bda2-1723f39d5320 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.713649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1f2d9-1653-4c85-bda2-1723f39d5320 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.724816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3ed10-9acb-456b-85d1-9345927a7df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.725615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ed10-9acb-456b-85d1-9345927a7df7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.725904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ed10-9acb-456b-85d1-9345927a7df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.726186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ed10-9acb-456b-85d1-9345927a7df7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-04d1f2d9-1653-4c85-bda2-1723f39d5320 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:20.729227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:20.730151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 282/581] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:20.736128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1f2d9-1653-4c85-bda2-1723f39d5320 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.743050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3ed10-9acb-456b-85d1-9345927a7df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-f0a3ed10-9acb-456b-85d1-9345927a7df7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:20.750771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:20.752271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 300/582] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:20.753846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3ed10-9acb-456b-85d1-9345927a7df7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.822601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:20.867405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1f2d9-1653-4c85-bda2-1723f39d5320 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.881239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3ed10-9acb-456b-85d1-9345927a7df7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:20.908592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446019d2-a07c-4f84-9a30-49fc7a71b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.909553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446019d2-a07c-4f84-9a30-49fc7a71b4c9 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.909845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446019d2-a07c-4f84-9a30-49fc7a71b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.910130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446019d2-a07c-4f84-9a30-49fc7a71b4c9 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6cba70fa423e413a9222021116ff5718/roles/9e9a366e60114fa1ae7e33a6a7af2934` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.920338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257fc5f-f45a-45bf-b650-53c937c39f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:20.921016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257fc5f-f45a-45bf-b650-53c937c39f5e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:20.921296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257fc5f-f45a-45bf-b650-53c937c39f5e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:20.921571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257fc5f-f45a-45bf-b650-53c937c39f5e None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:20.922307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257fc5f-f45a-45bf-b650-53c937c39f5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:20.922667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257fc5f-f45a-45bf-b650-53c937c39f5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.924082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257fc5f-f45a-45bf-b650-53c937c39f5e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.927779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446019d2-a07c-4f84-9a30-49fc7a71b4c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=6cba70fa423e413a9222021116ff5718, role_id=9e9a366e60114fa1ae7e33a6a7af2934)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:20.929273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446019d2-a07c-4f84-9a30-49fc7a71b4c9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:20.944791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 283/584] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:20 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6cba70fa423e413a9222021116ff5718/roles/9e9a366e60114fa1ae7e33a6a7af2934 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:20.944984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 301/584] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:20.945826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257fc5f-f45a-45bf-b650-53c937c39f5e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.946307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446019d2-a07c-4f84-9a30-49fc7a71b4c9 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:20.998833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.100653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257fc5f-f45a-45bf-b650-53c937c39f5e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.108371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446019d2-a07c-4f84-9a30-49fc7a71b4c9 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.137612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.149598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf45c7-3876-4000-ace4-045aa7d3679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:21.150278 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf45c7-3876-4000-ace4-045aa7d3679a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.150642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf45c7-3876-4000-ace4-045aa7d3679a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.150924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf45c7-3876-4000-ace4-045aa7d3679a None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.151883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf45c7-3876-4000-ace4-045aa7d3679a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:21.152080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf45c7-3876-4000-ace4-045aa7d3679a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:21.153581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf45c7-3876-4000-ace4-045aa7d3679a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:21.165536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d40e-e63f-45b5-a70a-10b475045048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:21.166215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d40e-e63f-45b5-a70a-10b475045048 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.166545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d40e-e63f-45b5-a70a-10b475045048 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.166820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d40e-e63f-45b5-a70a-10b475045048 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.167577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d40e-e63f-45b5-a70a-10b475045048 None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:21.167881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d40e-e63f-45b5-a70a-10b475045048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:21.169416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d40e-e63f-45b5-a70a-10b475045048 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:21.176032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 302/585] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:21.176900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf45c7-3876-4000-ace4-045aa7d3679a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.180647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 284/586] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:21.186215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d40e-e63f-45b5-a70a-10b475045048 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.300059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d40e-e63f-45b5-a70a-10b475045048 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.302526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.324727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf45c7-3876-4000-ace4-045aa7d3679a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.355072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339898-3508-495f-91eb-603a3bf61c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:21.356414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339898-3508-495f-91eb-603a3bf61c49 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.356998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339898-3508-495f-91eb-603a3bf61c49 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.357639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339898-3508-495f-91eb-603a3bf61c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.375522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339898-3508-495f-91eb-603a3bf61c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:21.375817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb724-dab2-49bf-bb09-1868ac602ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:21.376815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb724-dab2-49bf-bb09-1868ac602ad6 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.377265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb724-dab2-49bf-bb09-1868ac602ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.378274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb724-dab2-49bf-bb09-1868ac602ad6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.378973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339898-3508-495f-91eb-603a3bf61c49 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:21.387552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb724-dab2-49bf-bb09-1868ac602ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:21.389260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb724-dab2-49bf-bb09-1868ac602ad6 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-1fbcb724-dab2-49bf-bb09-1868ac602ad6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:21.406812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:21.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:21.409124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:21.411767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 303/587] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:21.412759 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb724-dab2-49bf-bb09-1868ac602ad6 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-a2339898-3508-495f-91eb-603a3bf61c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:21.414842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:21.415740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:21.416638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:21.416638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:21.416638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:21.416638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:21.423152 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 285/588] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:21.423933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339898-3508-495f-91eb-603a3bf61c49 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.460238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.558558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339898-3508-495f-91eb-603a3bf61c49 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.565598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb724-dab2-49bf-bb09-1868ac602ad6 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.595318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9690c54-7ccf-4aec-bcb7-83096bf96aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:21.596014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690c54-7ccf-4aec-bcb7-83096bf96aef None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.596818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690c54-7ccf-4aec-bcb7-83096bf96aef None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.597254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690c54-7ccf-4aec-bcb7-83096bf96aef None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.598044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690c54-7ccf-4aec-bcb7-83096bf96aef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:21.598366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690c54-7ccf-4aec-bcb7-83096bf96aef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:21.599841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690c54-7ccf-4aec-bcb7-83096bf96aef None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:21.613450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931d81f-f437-43eb-891d-e7181488aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:21.614180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931d81f-f437-43eb-891d-e7181488aeec None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.614486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931d81f-f437-43eb-891d-e7181488aeec None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.614765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931d81f-f437-43eb-891d-e7181488aeec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.627705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 286/589] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:21.627705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9690c54-7ccf-4aec-bcb7-83096bf96aef None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.630119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931d81f-f437-43eb-891d-e7181488aeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:21.631798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931d81f-f437-43eb-891d-e7181488aeec None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:21.642052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-8931d81f-f437-43eb-891d-e7181488aeec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:21.653231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:21.654418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:21.655504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:21.655504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:21.655504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:21.655504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:21.662500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 304/590] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:21.662500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931d81f-f437-43eb-891d-e7181488aeec None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.749612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.761372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9690c54-7ccf-4aec-bcb7-83096bf96aef None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.774547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931d81f-f437-43eb-891d-e7181488aeec None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.805627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd5f14-2da0-4181-80c1-d58139c64990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:21.806830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd5f14-2da0-4181-80c1-d58139c64990 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.807258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd5f14-2da0-4181-80c1-d58139c64990 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.807830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd5f14-2da0-4181-80c1-d58139c64990 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.809122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd5f14-2da0-4181-80c1-d58139c64990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:21.809845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd5f14-2da0-4181-80c1-d58139c64990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:21.811753 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd5f14-2da0-4181-80c1-d58139c64990 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:21.814195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b5911-586b-462b-871c-9ef0fcc580e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:21.815814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b5911-586b-462b-871c-9ef0fcc580e1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:21.816197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b5911-586b-462b-871c-9ef0fcc580e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:21.816569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b5911-586b-462b-871c-9ef0fcc580e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:21.826760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 287/591] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:21.827935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd5f14-2da0-4181-80c1-d58139c64990 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.832727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b5911-586b-462b-871c-9ef0fcc580e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:21.834640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b5911-586b-462b-871c-9ef0fcc580e1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e20b5911-586b-462b-871c-9ef0fcc580e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:21.859054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:21.860289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:21.861816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:21.861816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:21.861816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:21.861816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:21.866586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 305/592] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:21.866586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b5911-586b-462b-871c-9ef0fcc580e1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:21.934973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:21.963463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd5f14-2da0-4181-80c1-d58139c64990 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:21.991227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b5911-586b-462b-871c-9ef0fcc580e1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.011113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ff76-4478-4eb2-81d5-65825ca2d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.011779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ff76-4478-4eb2-81d5-65825ca2d76a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.012063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ff76-4478-4eb2-81d5-65825ca2d76a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.012339 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ff76-4478-4eb2-81d5-65825ca2d76a None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.013387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8ff76-4478-4eb2-81d5-65825ca2d76a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:22.013696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8ff76-4478-4eb2-81d5-65825ca2d76a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.015229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8ff76-4478-4eb2-81d5-65825ca2d76a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.036103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 288/593] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:22.036103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ff76-4478-4eb2-81d5-65825ca2d76a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.036364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc29bee-79ac-4742-9e55-24d7cc13ca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.036364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc29bee-79ac-4742-9e55-24d7cc13ca35 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.036364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc29bee-79ac-4742-9e55-24d7cc13ca35 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.036364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc29bee-79ac-4742-9e55-24d7cc13ca35 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.047044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc29bee-79ac-4742-9e55-24d7cc13ca35 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.048971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc29bee-79ac-4742-9e55-24d7cc13ca35 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.049534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-bdc29bee-79ac-4742-9e55-24d7cc13ca35 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:22.067599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:22.068602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:22.069525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:22.077801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 306/594] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:22.079045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc29bee-79ac-4742-9e55-24d7cc13ca35 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.153749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ff76-4478-4eb2-81d5-65825ca2d76a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.198431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66559d00-4217-4162-9d32-922318b05b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.199109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66559d00-4217-4162-9d32-922318b05b36 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.199850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66559d00-4217-4162-9d32-922318b05b36 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.200141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66559d00-4217-4162-9d32-922318b05b36 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.200880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66559d00-4217-4162-9d32-922318b05b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:22.201473 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66559d00-4217-4162-9d32-922318b05b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.202991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66559d00-4217-4162-9d32-922318b05b36 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.215382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 289/595] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:22.216224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66559d00-4217-4162-9d32-922318b05b36 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.227204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc29bee-79ac-4742-9e55-24d7cc13ca35 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.241715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.266701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9e3e6-682d-41e8-bf49-79384039ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.267777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9e3e6-682d-41e8-bf49-79384039ba43 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.268863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9e3e6-682d-41e8-bf49-79384039ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.269293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9e3e6-682d-41e8-bf49-79384039ba43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.277214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9e3e6-682d-41e8-bf49-79384039ba43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.279208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9e3e6-682d-41e8-bf49-79384039ba43 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.292364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-53a9e3e6-682d-41e8-bf49-79384039ba43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:22.295888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:22.296848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:22.297807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:22.297807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:22.297807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:22.297807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:22.297807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:22.297807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:22.297807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:22.297807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:22.299885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 307/596] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:22.300900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9e3e6-682d-41e8-bf49-79384039ba43 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.328841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66559d00-4217-4162-9d32-922318b05b36 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.370749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbbb5f-3da9-4bce-adf3-576338adaa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.371443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbb5f-3da9-4bce-adf3-576338adaa4f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.371974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbb5f-3da9-4bce-adf3-576338adaa4f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.372260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbb5f-3da9-4bce-adf3-576338adaa4f None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.373112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbbb5f-3da9-4bce-adf3-576338adaa4f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:22.373452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbbb5f-3da9-4bce-adf3-576338adaa4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.375864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbbb5f-3da9-4bce-adf3-576338adaa4f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.399780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 290/597] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:22.401176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbbb5f-3da9-4bce-adf3-576338adaa4f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.420984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9e3e6-682d-41e8-bf49-79384039ba43 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.467294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0f8aa-4818-41c9-9ef0-93b3f3129c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.468084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0f8aa-4818-41c9-9ef0-93b3f3129c0a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.468368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0f8aa-4818-41c9-9ef0-93b3f3129c0a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.468647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0f8aa-4818-41c9-9ef0-93b3f3129c0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.477461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0f8aa-4818-41c9-9ef0-93b3f3129c0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.479085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0f8aa-4818-41c9-9ef0-93b3f3129c0a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-f5b0f8aa-4818-41c9-9ef0-93b3f3129c0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:22.498288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:22.499437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:22.500405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:22.500405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:22.500405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:22.500405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:22.500405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:22.500405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:22.500405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:22.500405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:22.508217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 308/598] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:22.509236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0f8aa-4818-41c9-9ef0-93b3f3129c0a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.529665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbbb5f-3da9-4bce-adf3-576338adaa4f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.551228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.560742 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.571753 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19477be-2796-4909-b92f-149ab737a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.572788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19477be-2796-4909-b92f-149ab737a3fc None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.573285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19477be-2796-4909-b92f-149ab737a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.573832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19477be-2796-4909-b92f-149ab737a3fc None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.575001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19477be-2796-4909-b92f-149ab737a3fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:22.575547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19477be-2796-4909-b92f-149ab737a3fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.577338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19477be-2796-4909-b92f-149ab737a3fc None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.596963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 291/599] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:22.596963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19477be-2796-4909-b92f-149ab737a3fc None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.636538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0f8aa-4818-41c9-9ef0-93b3f3129c0a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.673295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068db1cf-ccc2-4074-a9d8-d81179080a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.674021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068db1cf-ccc2-4074-a9d8-d81179080a8f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.674301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068db1cf-ccc2-4074-a9d8-d81179080a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.675297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068db1cf-ccc2-4074-a9d8-d81179080a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.687931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068db1cf-ccc2-4074-a9d8-d81179080a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.689551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068db1cf-ccc2-4074-a9d8-d81179080a8f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.708467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19477be-2796-4909-b92f-149ab737a3fc None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-068db1cf-ccc2-4074-a9d8-d81179080a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:22.714315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:22.715456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:22.716535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:22.716535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:22.716535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:22.716535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:22.720206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 309/600] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:22.721502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f72d7-e915-4ce2-8d77-aa87f27f26ef None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.721787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f72d7-e915-4ce2-8d77-aa87f27f26ef None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.722059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f72d7-e915-4ce2-8d77-aa87f27f26ef None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.726425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 310/601] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:22.726425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f72d7-e915-4ce2-8d77-aa87f27f26ef None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.755966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1675b1e-6530-4f32-a700-419b579196cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.756643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1675b1e-6530-4f32-a700-419b579196cd None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.756932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1675b1e-6530-4f32-a700-419b579196cd None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.757219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1675b1e-6530-4f32-a700-419b579196cd None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.758027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1675b1e-6530-4f32-a700-419b579196cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:22.758344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1675b1e-6530-4f32-a700-419b579196cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.759841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1675b1e-6530-4f32-a700-419b579196cd None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.773059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 292/602] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:22.773899 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1675b1e-6530-4f32-a700-419b579196cd None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:22.826511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.828987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:22.845358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f72d7-e915-4ce2-8d77-aa87f27f26ef None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.893738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1675b1e-6530-4f32-a700-419b579196cd None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:22.896376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c886ad3-69bc-4c00-87c4-b72492c25376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.897486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c886ad3-69bc-4c00-87c4-b72492c25376 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.897764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c886ad3-69bc-4c00-87c4-b72492c25376 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.898036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c886ad3-69bc-4c00-87c4-b72492c25376 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/387fd99ff326463698bc32947ba25d77/roles/9e9a366e60114fa1ae7e33a6a7af2934` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.914051 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c886ad3-69bc-4c00-87c4-b72492c25376 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=387fd99ff326463698bc32947ba25d77, role_id=9e9a366e60114fa1ae7e33a6a7af2934)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.915549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c886ad3-69bc-4c00-87c4-b72492c25376 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.935473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 311/603] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:22 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/387fd99ff326463698bc32947ba25d77/roles/9e9a366e60114fa1ae7e33a6a7af2934 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:22.937833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f39df-2468-4662-9c65-0baaed7ecdc9 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.938156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f39df-2468-4662-9c65-0baaed7ecdc9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.938570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f39df-2468-4662-9c65-0baaed7ecdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.951117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927eb47-6293-40d6-9154-65f6e87adb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:22.952487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927eb47-6293-40d6-9154-65f6e87adb9a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:22.953224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927eb47-6293-40d6-9154-65f6e87adb9a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:22.953881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927eb47-6293-40d6-9154-65f6e87adb9a None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:22.955282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927eb47-6293-40d6-9154-65f6e87adb9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:22.956012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927eb47-6293-40d6-9154-65f6e87adb9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:22.958639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927eb47-6293-40d6-9154-65f6e87adb9a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:22.961370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1b0f39df-2468-4662-9c65-0baaed7ecdc9 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:22.962679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1b0f39df-2468-4662-9c65-0baaed7ecdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:22.978960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 293/604] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:22.980332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927eb47-6293-40d6-9154-65f6e87adb9a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.050413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 312/605] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:23.050413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f39df-2468-4662-9c65-0baaed7ecdc9 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.137470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927eb47-6293-40d6-9154-65f6e87adb9a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.138109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.152105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.190702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c936fe-b5b4-4bab-abeb-146804b4e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.191575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c936fe-b5b4-4bab-abeb-146804b4e730 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.191979 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c936fe-b5b4-4bab-abeb-146804b4e730 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.192292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c936fe-b5b4-4bab-abeb-146804b4e730 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/beb359ac9b084b38b77923219f42f655/roles/9e9a366e60114fa1ae7e33a6a7af2934` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.193336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f39df-2468-4662-9c65-0baaed7ecdc9 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.210879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c936fe-b5b4-4bab-abeb-146804b4e730 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=beb359ac9b084b38b77923219f42f655, role_id=9e9a366e60114fa1ae7e33a6a7af2934)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.212846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c936fe-b5b4-4bab-abeb-146804b4e730 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.230172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 294/606] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:22 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/beb359ac9b084b38b77923219f42f655/roles/9e9a366e60114fa1ae7e33a6a7af2934 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:23.231220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c936fe-b5b4-4bab-abeb-146804b4e730 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.270999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84ba51-be40-44b9-a2c7-abb466006768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.271883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ba51-be40-44b9-a2c7-abb466006768 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.272169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ba51-be40-44b9-a2c7-abb466006768 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.272442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ba51-be40-44b9-a2c7-abb466006768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.283769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84ba51-be40-44b9-a2c7-abb466006768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.285872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84ba51-be40-44b9-a2c7-abb466006768 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-7e84ba51-be40-44b9-a2c7-abb466006768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:23.311978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:23.312942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:23.313821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:23.313821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:23.313821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:23.313821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:23.313821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:23.313821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:23.313821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:23.313821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:23.313821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 313/607] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:23.315925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa77e18-9d76-40dd-ba76-5379787bbfb9 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.316296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa77e18-9d76-40dd-ba76-5379787bbfb9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.316580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa77e18-9d76-40dd-ba76-5379787bbfb9 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.319372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 314/608] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:23.321256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa77e18-9d76-40dd-ba76-5379787bbfb9 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.418212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c936fe-b5b4-4bab-abeb-146804b4e730 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.467100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba4543-15cf-4434-b116-458a24c86ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.468004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba4543-15cf-4434-b116-458a24c86ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.468311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba4543-15cf-4434-b116-458a24c86ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.468588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba4543-15cf-4434-b116-458a24c86ed9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.477372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa77e18-9d76-40dd-ba76-5379787bbfb9 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.483542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba4543-15cf-4434-b116-458a24c86ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-f2ba4543-15cf-4434-b116-458a24c86ed9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:23.495146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:23.496138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:23.496995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:23.500127 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 295/609] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:23.501721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799dabb-ddb3-4058-8cbc-cb132a36cdde None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.502153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799dabb-ddb3-4058-8cbc-cb132a36cdde None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.502593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799dabb-ddb3-4058-8cbc-cb132a36cdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.519843 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.530448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-5799dabb-ddb3-4058-8cbc-cb132a36cdde None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:23.531372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5799dabb-ddb3-4058-8cbc-cb132a36cdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:23.536171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067b930-fcc7-4e73-9053-f82e82759b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.537109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067b930-fcc7-4e73-9053-f82e82759b59 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.537541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067b930-fcc7-4e73-9053-f82e82759b59 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.537964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067b930-fcc7-4e73-9053-f82e82759b59 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.539012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067b930-fcc7-4e73-9053-f82e82759b59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:23.539530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067b930-fcc7-4e73-9053-f82e82759b59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.541206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067b930-fcc7-4e73-9053-f82e82759b59 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.548635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.555745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 315/610] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:23.561706 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067b930-fcc7-4e73-9053-f82e82759b59 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.614532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 296/611] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:23.615561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799dabb-ddb3-4058-8cbc-cb132a36cdde None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.675333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067b930-fcc7-4e73-9053-f82e82759b59 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.718871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848182a6-d8e4-4f85-984f-718bbed3ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.719988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848182a6-d8e4-4f85-984f-718bbed3ec32 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.720525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848182a6-d8e4-4f85-984f-718bbed3ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.720991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848182a6-d8e4-4f85-984f-718bbed3ec32 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.722501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848182a6-d8e4-4f85-984f-718bbed3ec32 None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:23.723018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848182a6-d8e4-4f85-984f-718bbed3ec32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.724604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848182a6-d8e4-4f85-984f-718bbed3ec32 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.731976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799dabb-ddb3-4058-8cbc-cb132a36cdde None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.734424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 316/612] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:23.735489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848182a6-d8e4-4f85-984f-718bbed3ec32 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.785092 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951e38a-e2df-48bb-8e83-5b28fd883105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.785993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e38a-e2df-48bb-8e83-5b28fd883105 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.786318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e38a-e2df-48bb-8e83-5b28fd883105 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.786886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e38a-e2df-48bb-8e83-5b28fd883105 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/e11a8567e1254a0080cbe74efe0127f5/roles/9e9a366e60114fa1ae7e33a6a7af2934` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.804293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951e38a-e2df-48bb-8e83-5b28fd883105 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=e11a8567e1254a0080cbe74efe0127f5, role_id=9e9a366e60114fa1ae7e33a6a7af2934)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:23.805765 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951e38a-e2df-48bb-8e83-5b28fd883105 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:23.806105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.816489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:23.834415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 297/613] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:23 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/e11a8567e1254a0080cbe74efe0127f5/roles/9e9a366e60114fa1ae7e33a6a7af2934 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:23.834415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951e38a-e2df-48bb-8e83-5b28fd883105 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:23.896641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848182a6-d8e4-4f85-984f-718bbed3ec32 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.950439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951e38a-e2df-48bb-8e83-5b28fd883105 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:23.971325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158597a-ed48-4eb2-9895-08b51e9163ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.972673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158597a-ed48-4eb2-9895-08b51e9163ca None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.973412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158597a-ed48-4eb2-9895-08b51e9163ca None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.974175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158597a-ed48-4eb2-9895-08b51e9163ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.994163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c00dd-c317-4e04-b493-c370a229c377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:23.995103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c00dd-c317-4e04-b493-c370a229c377 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:23.995384 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c00dd-c317-4e04-b493-c370a229c377 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:23.995708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c00dd-c317-4e04-b493-c370a229c377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:23.999193 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158597a-ed48-4eb2-9895-08b51e9163ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-2158597a-ed48-4eb2-9895-08b51e9163ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:24.008729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:24.009769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:24.010885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:24.011627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c00dd-c317-4e04-b493-c370a229c377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:24.014507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c00dd-c317-4e04-b493-c370a229c377 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:24.019495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 317/614] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:24.025451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158597a-ed48-4eb2-9895-08b51e9163ca None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-832c00dd-c317-4e04-b493-c370a229c377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:24.046167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:24.048333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:24.050495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:24.050495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:24.050495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:24.050495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:24.050495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 298/615] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:24.056173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c00dd-c317-4e04-b493-c370a229c377 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:24.159871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:24.223539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158597a-ed48-4eb2-9895-08b51e9163ca None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:24.233135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c00dd-c317-4e04-b493-c370a229c377 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:24.234573 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:24.277449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a5c23-ff6f-400c-86bd-6b592809a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:24.278545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a5c23-ff6f-400c-86bd-6b592809a391 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:24.279051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a5c23-ff6f-400c-86bd-6b592809a391 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:24.279930 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a5c23-ff6f-400c-86bd-6b592809a391 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:24.281173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a5c23-ff6f-400c-86bd-6b592809a391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:24.281826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a5c23-ff6f-400c-86bd-6b592809a391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:24.283495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a5c23-ff6f-400c-86bd-6b592809a391 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:24.297625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 299/616] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:24.303458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a5c23-ff6f-400c-86bd-6b592809a391 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:24.311659 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5a9d-9166-4510-a116-e5b6863f2516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:24.313116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5a9d-9166-4510-a116-e5b6863f2516 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:24.313662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5a9d-9166-4510-a116-e5b6863f2516 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:24.314714 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5a9d-9166-4510-a116-e5b6863f2516 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:24.317500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b5a9d-9166-4510-a116-e5b6863f2516 None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:24.318094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b5a9d-9166-4510-a116-e5b6863f2516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:24.319716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b5a9d-9166-4510-a116-e5b6863f2516 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:24.340350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 318/617] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:24.346161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5a9d-9166-4510-a116-e5b6863f2516 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:24.446665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a5c23-ff6f-400c-86bd-6b592809a391 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:24.470827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:24.489334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e93d-44da-4a46-aa99-77a966fe24f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:24.490451 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e93d-44da-4a46-aa99-77a966fe24f3 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:24.490960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e93d-44da-4a46-aa99-77a966fe24f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:24.491448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e93d-44da-4a46-aa99-77a966fe24f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:24.500158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67e93d-44da-4a46-aa99-77a966fe24f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:24.501921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67e93d-44da-4a46-aa99-77a966fe24f3 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-7b67e93d-44da-4a46-aa99-77a966fe24f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:24.519133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:24.520071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:24.521008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:24.523928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 300/618] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:24.534504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e93d-44da-4a46-aa99-77a966fe24f3 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:24.670075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e93d-44da-4a46-aa99-77a966fe24f3 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:24.689688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5a9d-9166-4510-a116-e5b6863f2516 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:24.724663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc4528-a03f-4c33-b5b2-d1783156dd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:24.725465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc4528-a03f-4c33-b5b2-d1783156dd56 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:24.725755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc4528-a03f-4c33-b5b2-d1783156dd56 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:24.726035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc4528-a03f-4c33-b5b2-d1783156dd56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:24.737144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc4528-a03f-4c33-b5b2-d1783156dd56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:24.739148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc4528-a03f-4c33-b5b2-d1783156dd56 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-eabc4528-a03f-4c33-b5b2-d1783156dd56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:24.756694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:24.757748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:24.758655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:24.758655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:24.758655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:24.758655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:24.758655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 319/619] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:24.765333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc4528-a03f-4c33-b5b2-d1783156dd56 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:24.768061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61da083-9202-4963-a8fe-7a9e24231cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:24.768967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61da083-9202-4963-a8fe-7a9e24231cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:24.769343 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61da083-9202-4963-a8fe-7a9e24231cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:24.769699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61da083-9202-4963-a8fe-7a9e24231cc1 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:24.770871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61da083-9202-4963-a8fe-7a9e24231cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:24.771281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61da083-9202-4963-a8fe-7a9e24231cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:24.773394 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61da083-9202-4963-a8fe-7a9e24231cc1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:24.797240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 301/620] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:24.803701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:24.805907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61da083-9202-4963-a8fe-7a9e24231cc1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:24.862794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:24.955636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61da083-9202-4963-a8fe-7a9e24231cc1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:24.967470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc4528-a03f-4c33-b5b2-d1783156dd56 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:25.019302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550e00-517b-403c-b652-6cbd1fe27cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.020020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550e00-517b-403c-b652-6cbd1fe27cca None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.020304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550e00-517b-403c-b652-6cbd1fe27cca None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.020586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550e00-517b-403c-b652-6cbd1fe27cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.025631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719438a9-4eaf-4c8f-b6a7-3e51ec01920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.026288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719438a9-4eaf-4c8f-b6a7-3e51ec01920f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.026595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719438a9-4eaf-4c8f-b6a7-3e51ec01920f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.026875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719438a9-4eaf-4c8f-b6a7-3e51ec01920f None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.027605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719438a9-4eaf-4c8f-b6a7-3e51ec01920f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:25.027912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719438a9-4eaf-4c8f-b6a7-3e51ec01920f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:25.029288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719438a9-4eaf-4c8f-b6a7-3e51ec01920f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:25.045938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76550e00-517b-403c-b652-6cbd1fe27cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:25.047443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76550e00-517b-403c-b652-6cbd1fe27cca None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:25.057174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 320/621] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:25.058497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719438a9-4eaf-4c8f-b6a7-3e51ec01920f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-76550e00-517b-403c-b652-6cbd1fe27cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:25.073698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:25.074660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:25.075558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:25.075558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:25.075558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:25.075558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:25.079946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 302/622] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:25.083477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550e00-517b-403c-b652-6cbd1fe27cca None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.265577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:25.288365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:25.313390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76550e00-517b-403c-b652-6cbd1fe27cca None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:25.317990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719438a9-4eaf-4c8f-b6a7-3e51ec01920f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:25.379150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44a6b3-3390-46fb-ba06-016b9433f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.380803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a6b3-3390-46fb-ba06-016b9433f00c None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.381128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a6b3-3390-46fb-ba06-016b9433f00c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.381472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a6b3-3390-46fb-ba06-016b9433f00c None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.382225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44a6b3-3390-46fb-ba06-016b9433f00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:25.382568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44a6b3-3390-46fb-ba06-016b9433f00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:25.384796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44a6b3-3390-46fb-ba06-016b9433f00c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:25.400915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 303/623] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:25.407359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44a6b3-3390-46fb-ba06-016b9433f00c None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.426009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f689306-20fd-4791-b225-a2c0d9d57e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.426957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689306-20fd-4791-b225-a2c0d9d57e75 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.427242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689306-20fd-4791-b225-a2c0d9d57e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.427557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689306-20fd-4791-b225-a2c0d9d57e75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.444188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f689306-20fd-4791-b225-a2c0d9d57e75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:25.445759 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f689306-20fd-4791-b225-a2c0d9d57e75 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-2f689306-20fd-4791-b225-a2c0d9d57e75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:25.481124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:25.482148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:25.483122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 321/624] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:25.506163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f689306-20fd-4791-b225-a2c0d9d57e75 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.564928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44a6b3-3390-46fb-ba06-016b9433f00c None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:25.612299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e2109-2cee-4102-a4de-ea787667459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.613172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e2109-2cee-4102-a4de-ea787667459d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.613532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e2109-2cee-4102-a4de-ea787667459d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.613841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e2109-2cee-4102-a4de-ea787667459d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.622432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e2109-2cee-4102-a4de-ea787667459d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:25.624083 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e2109-2cee-4102-a4de-ea787667459d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:25.627484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-c50e2109-2cee-4102-a4de-ea787667459d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:25.644717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:25.646542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:25.648446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:25.648446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:25.648446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:25.648446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:25.648446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:25.648446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:25.648446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:25.648446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:25.648446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 304/625] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:25.649421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b77c-2398-46a4-9868-3b3665b508c9 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.649421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b77c-2398-46a4-9868-3b3665b508c9 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.649421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9b77c-2398-46a4-9868-3b3665b508c9 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.654402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 305/626] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:25.654402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9b77c-2398-46a4-9868-3b3665b508c9 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.691678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f689306-20fd-4791-b225-a2c0d9d57e75 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:25.742599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cd56-4356-4985-99af-d5ed16ec6fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.743358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cd56-4356-4985-99af-d5ed16ec6fcd None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.743638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cd56-4356-4985-99af-d5ed16ec6fcd None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.743910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cd56-4356-4985-99af-d5ed16ec6fcd None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.744925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412cd56-4356-4985-99af-d5ed16ec6fcd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:25.745271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412cd56-4356-4985-99af-d5ed16ec6fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:25.746945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412cd56-4356-4985-99af-d5ed16ec6fcd None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:25.758656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:25.771692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 322/627] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:25.773272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728eb97-36cd-4e41-9788-224d733bf5b4 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.773562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728eb97-36cd-4e41-9788-224d733bf5b4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.773848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728eb97-36cd-4e41-9788-224d733bf5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.794659 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4728eb97-36cd-4e41-9788-224d733bf5b4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:25.795997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4728eb97-36cd-4e41-9788-224d733bf5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:25.798858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9b77c-2398-46a4-9868-3b3665b508c9 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:25.839925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcf0a6-196e-4749-bb85-07c3b9930f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:25.840636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcf0a6-196e-4749-bb85-07c3b9930f3f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.840925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcf0a6-196e-4749-bb85-07c3b9930f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.841296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcf0a6-196e-4749-bb85-07c3b9930f3f None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.842190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcf0a6-196e-4749-bb85-07c3b9930f3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:25.842610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcf0a6-196e-4749-bb85-07c3b9930f3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:25.844319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcf0a6-196e-4749-bb85-07c3b9930f3f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:25.859003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 306/628] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:25.860582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036f5c-5358-46fa-a1ec-3f2791a1bbeb None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:25.860907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036f5c-5358-46fa-a1ec-3f2791a1bbeb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:25.861376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036f5c-5358-46fa-a1ec-3f2791a1bbeb None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:25.862952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 307/629] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:25.867452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8036f5c-5358-46fa-a1ec-3f2791a1bbeb None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.894477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 323/630] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:25.895742 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728eb97-36cd-4e41-9788-224d733bf5b4 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:25.955065 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.006310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8036f5c-5358-46fa-a1ec-3f2791a1bbeb None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.030064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728eb97-36cd-4e41-9788-224d733bf5b4 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.049914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e69e-3648-4be9-ad0c-d817689f859e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.050631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e69e-3648-4be9-ad0c-d817689f859e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.050876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e69e-3648-4be9-ad0c-d817689f859e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.051142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8e69e-3648-4be9-ad0c-d817689f859e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.062078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.073105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee1efa-5ad0-4490-ab17-0ab63af1192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.074141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1efa-5ad0-4490-ab17-0ab63af1192f None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.074531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1efa-5ad0-4490-ab17-0ab63af1192f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.074827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1efa-5ad0-4490-ab17-0ab63af1192f None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/f7da017f9a5b4bfcb5b97b5310e0a146/roles/9e9a366e60114fa1ae7e33a6a7af2934` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.094240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee1efa-5ad0-4490-ab17-0ab63af1192f None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=f7da017f9a5b4bfcb5b97b5310e0a146, role_id=9e9a366e60114fa1ae7e33a6a7af2934)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.095948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee1efa-5ad0-4490-ab17-0ab63af1192f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.114363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 324/631] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:25 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/f7da017f9a5b4bfcb5b97b5310e0a146/roles/9e9a366e60114fa1ae7e33a6a7af2934 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:26.116531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79dced-8c54-4366-ac2f-93d04770cf54 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.116865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79dced-8c54-4366-ac2f-93d04770cf54 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.117206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79dced-8c54-4366-ac2f-93d04770cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.140396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1c79dced-8c54-4366-ac2f-93d04770cf54 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:26.141854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1c79dced-8c54-4366-ac2f-93d04770cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:26.149125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e69e-3648-4be9-ad0c-d817689f859e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.151610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8e69e-3648-4be9-ad0c-d817689f859e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.238605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 325/632] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:26.240239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79dced-8c54-4366-ac2f-93d04770cf54 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.243384 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.338486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 308/633] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:26.339517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e69e-3648-4be9-ad0c-d817689f859e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.426263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79dced-8c54-4366-ac2f-93d04770cf54 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.441506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.476477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209feb1f-5853-4ab4-8f6b-0a04e3803ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.477542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209feb1f-5853-4ab4-8f6b-0a04e3803ea6 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.477670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209feb1f-5853-4ab4-8f6b-0a04e3803ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.477964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209feb1f-5853-4ab4-8f6b-0a04e3803ea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.481743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8e69e-3648-4be9-ad0c-d817689f859e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.491364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209feb1f-5853-4ab4-8f6b-0a04e3803ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-209feb1f-5853-4ab4-8f6b-0a04e3803ea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:26.507305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:26.508208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:26.509153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:26.515485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 326/634] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:26.515485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209feb1f-5853-4ab4-8f6b-0a04e3803ea6 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.529439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f51d02-fb57-4c05-bca5-523da6c16c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.530310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f51d02-fb57-4c05-bca5-523da6c16c4e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.530842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f51d02-fb57-4c05-bca5-523da6c16c4e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.531160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f51d02-fb57-4c05-bca5-523da6c16c4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.543604 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f51d02-fb57-4c05-bca5-523da6c16c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-40f51d02-fb57-4c05-bca5-523da6c16c4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:26.552920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:26.554179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:26.555269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 309/635] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:26.556072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62149d5d-8ee8-4a38-be34-8e9cb1027350 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.556072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62149d5d-8ee8-4a38-be34-8e9cb1027350 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.556072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62149d5d-8ee8-4a38-be34-8e9cb1027350 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.557705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 310/636] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:26.558177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62149d5d-8ee8-4a38-be34-8e9cb1027350 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.590157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.665310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209feb1f-5853-4ab4-8f6b-0a04e3803ea6 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.687994 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62149d5d-8ee8-4a38-be34-8e9cb1027350 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.716319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8280ef-359f-49bd-84a9-9f2a0fbdb9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.717560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8280ef-359f-49bd-84a9-9f2a0fbdb9d2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.718123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8280ef-359f-49bd-84a9-9f2a0fbdb9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.718640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8280ef-359f-49bd-84a9-9f2a0fbdb9d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.734878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8280ef-359f-49bd-84a9-9f2a0fbdb9d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.736274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695e385-129f-450b-bac5-a0e18c854588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.736529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8280ef-359f-49bd-84a9-9f2a0fbdb9d2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.737189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e385-129f-450b-bac5-a0e18c854588 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.738165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e385-129f-450b-bac5-a0e18c854588 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.738563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e385-129f-450b-bac5-a0e18c854588 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.739620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695e385-129f-450b-bac5-a0e18c854588 None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:26.740310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695e385-129f-450b-bac5-a0e18c854588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.742205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695e385-129f-450b-bac5-a0e18c854588 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.757803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 311/637] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:26.757803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695e385-129f-450b-bac5-a0e18c854588 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-9b8280ef-359f-49bd-84a9-9f2a0fbdb9d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:26.758081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:26.758927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:26.759825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:26.759825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:26.759825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:26.759825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:26.759825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 327/638] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:26.759825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ed483-cc38-4963-8a74-a940abc2daa7 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.759825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ed483-cc38-4963-8a74-a940abc2daa7 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.759825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ed483-cc38-4963-8a74-a940abc2daa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.776937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4b8ed483-cc38-4963-8a74-a940abc2daa7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:26.778147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4b8ed483-cc38-4963-8a74-a940abc2daa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:26.798360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.862361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:26.869389 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 328/639] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:26.875874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ed483-cc38-4963-8a74-a940abc2daa7 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:26.889056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695e385-129f-450b-bac5-a0e18c854588 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:26.928614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323965a0-a32a-4a41-b327-973cd48df91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:26.929278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323965a0-a32a-4a41-b327-973cd48df91b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:26.929686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323965a0-a32a-4a41-b327-973cd48df91b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:26.929901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323965a0-a32a-4a41-b327-973cd48df91b None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:26.930706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323965a0-a32a-4a41-b327-973cd48df91b None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:26.931015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323965a0-a32a-4a41-b327-973cd48df91b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:26.932557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323965a0-a32a-4a41-b327-973cd48df91b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:26.947054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 312/640] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:26.947054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323965a0-a32a-4a41-b327-973cd48df91b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.014748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ed483-cc38-4963-8a74-a940abc2daa7 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.055388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19191f-3661-4f01-adec-626da1088082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.056192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19191f-3661-4f01-adec-626da1088082 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.056470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19191f-3661-4f01-adec-626da1088082 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.056744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19191f-3661-4f01-adec-626da1088082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.073040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323965a0-a32a-4a41-b327-973cd48df91b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.076877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19191f-3661-4f01-adec-626da1088082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.078483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19191f-3661-4f01-adec-626da1088082 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-ec19191f-3661-4f01-adec-626da1088082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:27.099569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:27.100637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:27.101537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:27.101537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:27.101537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:27.101537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:27.101537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 329/641] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:27.101823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19191f-3661-4f01-adec-626da1088082 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.105664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.117395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56f2bd-e9a7-47e4-8990-6dcbf6218d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.118124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56f2bd-e9a7-47e4-8990-6dcbf6218d14 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.118450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56f2bd-e9a7-47e4-8990-6dcbf6218d14 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.118739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56f2bd-e9a7-47e4-8990-6dcbf6218d14 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.119519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56f2bd-e9a7-47e4-8990-6dcbf6218d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.119836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56f2bd-e9a7-47e4-8990-6dcbf6218d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.121263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56f2bd-e9a7-47e4-8990-6dcbf6218d14 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.137301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 313/642] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.142766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56f2bd-e9a7-47e4-8990-6dcbf6218d14 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.148158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.217891 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19191f-3661-4f01-adec-626da1088082 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.262995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80cd6-0150-4f22-8770-a83560cdfbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.263794 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80cd6-0150-4f22-8770-a83560cdfbae None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.264078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80cd6-0150-4f22-8770-a83560cdfbae None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.264352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80cd6-0150-4f22-8770-a83560cdfbae None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.273093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56f2bd-e9a7-47e4-8990-6dcbf6218d14 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.277711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a80cd6-0150-4f22-8770-a83560cdfbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-b6a80cd6-0150-4f22-8770-a83560cdfbae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:27.287324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:27.288498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:27.289410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 330/643] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:27.290268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80cd6-0150-4f22-8770-a83560cdfbae None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.322704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a7510-94df-4409-ae45-0c47e2c919bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.323514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a7510-94df-4409-ae45-0c47e2c919bc None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.323806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a7510-94df-4409-ae45-0c47e2c919bc None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.324087 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a7510-94df-4409-ae45-0c47e2c919bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.335737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a7510-94df-4409-ae45-0c47e2c919bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.337209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a7510-94df-4409-ae45-0c47e2c919bc None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-205a7510-94df-4409-ae45-0c47e2c919bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:27.360736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:27.361760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:27.363298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:27.363298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:27.363298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:27.363298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:27.363298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 314/644] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:27.363298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a7510-94df-4409-ae45-0c47e2c919bc None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.370996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.419885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80cd6-0150-4f22-8770-a83560cdfbae None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.446664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.469025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71941ad3-2cf2-4063-8d0e-86312ed9deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.469701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71941ad3-2cf2-4063-8d0e-86312ed9deeb None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.470046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71941ad3-2cf2-4063-8d0e-86312ed9deeb None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.470403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71941ad3-2cf2-4063-8d0e-86312ed9deeb None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.471467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71941ad3-2cf2-4063-8d0e-86312ed9deeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.471594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71941ad3-2cf2-4063-8d0e-86312ed9deeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.473518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71941ad3-2cf2-4063-8d0e-86312ed9deeb None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.486492 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 331/645] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.487266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71941ad3-2cf2-4063-8d0e-86312ed9deeb None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.514293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a7510-94df-4409-ae45-0c47e2c919bc None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.562904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f711a-5eab-4fb1-88aa-bdeb7006ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.563698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f711a-5eab-4fb1-88aa-bdeb7006ee4f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.563986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f711a-5eab-4fb1-88aa-bdeb7006ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.564262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f711a-5eab-4fb1-88aa-bdeb7006ee4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.571833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f711a-5eab-4fb1-88aa-bdeb7006ee4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.573330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f711a-5eab-4fb1-88aa-bdeb7006ee4f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-883f711a-5eab-4fb1-88aa-bdeb7006ee4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:27.588943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:27.590081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 315/646] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:27.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f711a-5eab-4fb1-88aa-bdeb7006ee4f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.621783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71941ad3-2cf2-4063-8d0e-86312ed9deeb None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.645134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.657280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c8407-3ccb-4a27-9c26-26d9b5f12108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.658023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c8407-3ccb-4a27-9c26-26d9b5f12108 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.658310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c8407-3ccb-4a27-9c26-26d9b5f12108 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.658624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c8407-3ccb-4a27-9c26-26d9b5f12108 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.659866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c8407-3ccb-4a27-9c26-26d9b5f12108 None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.660172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c8407-3ccb-4a27-9c26-26d9b5f12108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.661515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c8407-3ccb-4a27-9c26-26d9b5f12108 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.669695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 332/647] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.670493 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c8407-3ccb-4a27-9c26-26d9b5f12108 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.711085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f711a-5eab-4fb1-88aa-bdeb7006ee4f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.733799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.753371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9c6fc-19a0-438b-b5cc-b610fe2786db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.754041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9c6fc-19a0-438b-b5cc-b610fe2786db None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.754329 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9c6fc-19a0-438b-b5cc-b610fe2786db None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.754641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9c6fc-19a0-438b-b5cc-b610fe2786db None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.755374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9c6fc-19a0-438b-b5cc-b610fe2786db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.755686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9c6fc-19a0-438b-b5cc-b610fe2786db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.757062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9c6fc-19a0-438b-b5cc-b610fe2786db None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.777203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 316/648] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.777203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9c6fc-19a0-438b-b5cc-b610fe2786db None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.784846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c8407-3ccb-4a27-9c26-26d9b5f12108 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.835062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a0a28-62a4-4244-842b-3ac551f74e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.835856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a0a28-62a4-4244-842b-3ac551f74e44 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.836134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a0a28-62a4-4244-842b-3ac551f74e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.836402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a0a28-62a4-4244-842b-3ac551f74e44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.844413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a0a28-62a4-4244-842b-3ac551f74e44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.845894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a0a28-62a4-4244-842b-3ac551f74e44 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e23a0a28-62a4-4244-842b-3ac551f74e44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:27.861099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:27.862059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:27.863108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 333/649] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:27.863696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a0a28-62a4-4244-842b-3ac551f74e44 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.890411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9c6fc-19a0-438b-b5cc-b610fe2786db None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.913250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:27.926131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022304d3-6509-4027-b5e0-cbbfd73d66d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:27.926828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022304d3-6509-4027-b5e0-cbbfd73d66d1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:27.927104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022304d3-6509-4027-b5e0-cbbfd73d66d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:27.927375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022304d3-6509-4027-b5e0-cbbfd73d66d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:27.928158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022304d3-6509-4027-b5e0-cbbfd73d66d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:27.928462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022304d3-6509-4027-b5e0-cbbfd73d66d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:27.929888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022304d3-6509-4027-b5e0-cbbfd73d66d1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:27.944326 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 317/650] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:27.945189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022304d3-6509-4027-b5e0-cbbfd73d66d1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:27.977463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a0a28-62a4-4244-842b-3ac551f74e44 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:27.983027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.014706 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca4f71-9e80-4d17-8265-9b0f40bb80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.015431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca4f71-9e80-4d17-8265-9b0f40bb80df None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.015714 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca4f71-9e80-4d17-8265-9b0f40bb80df None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.015997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca4f71-9e80-4d17-8265-9b0f40bb80df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.027309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca4f71-9e80-4d17-8265-9b0f40bb80df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.028767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca4f71-9e80-4d17-8265-9b0f40bb80df None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-b9ca4f71-9e80-4d17-8265-9b0f40bb80df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:28.046981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:28.047865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:28.048774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:28.048774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:28.048774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:28.048774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:28.052833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 334/651] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:28.053456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca4f71-9e80-4d17-8265-9b0f40bb80df None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.056111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022304d3-6509-4027-b5e0-cbbfd73d66d1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.092728 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5f466-8c68-4b9e-a57b-e9bf320fead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.093667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f466-8c68-4b9e-a57b-e9bf320fead0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.094317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f466-8c68-4b9e-a57b-e9bf320fead0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.094317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f466-8c68-4b9e-a57b-e9bf320fead0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.103098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5f466-8c68-4b9e-a57b-e9bf320fead0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.104548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5f466-8c68-4b9e-a57b-e9bf320fead0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-c4a5f466-8c68-4b9e-a57b-e9bf320fead0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:28.119125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:28.120076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:28.121025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 318/652] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:28.121716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5f466-8c68-4b9e-a57b-e9bf320fead0 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.156339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.163202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca4f71-9e80-4d17-8265-9b0f40bb80df None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.201195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc154b-114f-4dac-a60e-a94cb265f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.202298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc154b-114f-4dac-a60e-a94cb265f28d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.202617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc154b-114f-4dac-a60e-a94cb265f28d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.202897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc154b-114f-4dac-a60e-a94cb265f28d None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.204103 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc154b-114f-4dac-a60e-a94cb265f28d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:28.204421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc154b-114f-4dac-a60e-a94cb265f28d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.206757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc154b-114f-4dac-a60e-a94cb265f28d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.221469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.226517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 335/653] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:28.228495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5f466-8c68-4b9e-a57b-e9bf320fead0 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.231307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc154b-114f-4dac-a60e-a94cb265f28d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.269718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49a3bd-35cb-4457-8752-83a100fe3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.270312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49a3bd-35cb-4457-8752-83a100fe3f8e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.270599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49a3bd-35cb-4457-8752-83a100fe3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.270871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49a3bd-35cb-4457-8752-83a100fe3f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.271700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49a3bd-35cb-4457-8752-83a100fe3f8e None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6cba70fa423e413a9222021116ff5718) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:28.272009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49a3bd-35cb-4457-8752-83a100fe3f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.273964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49a3bd-35cb-4457-8752-83a100fe3f8e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.286418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 319/654] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/role_assignments?user.id=6cba70fa423e413a9222021116ff5718&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:28.286418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49a3bd-35cb-4457-8752-83a100fe3f8e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.346090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc154b-114f-4dac-a60e-a94cb265f28d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.386221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f24283-93b6-4053-9548-114d3e58dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.386994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24283-93b6-4053-9548-114d3e58dafe None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.387283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24283-93b6-4053-9548-114d3e58dafe None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.387566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24283-93b6-4053-9548-114d3e58dafe None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.388340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f24283-93b6-4053-9548-114d3e58dafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:28.388655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f24283-93b6-4053-9548-114d3e58dafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.390062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f24283-93b6-4053-9548-114d3e58dafe None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.402805 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 336/655] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:28.407950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f24283-93b6-4053-9548-114d3e58dafe None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.426736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.431308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49a3bd-35cb-4457-8752-83a100fe3f8e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.469262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4f61e-b5d7-41a6-b2c5-ad32e5b4c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.469939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4f61e-b5d7-41a6-b2c5-ad32e5b4c5ea None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.470223 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4f61e-b5d7-41a6-b2c5-ad32e5b4c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.470530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4f61e-b5d7-41a6-b2c5-ad32e5b4c5ea None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.471374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4f61e-b5d7-41a6-b2c5-ad32e5b4c5ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:28.472855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4f61e-b5d7-41a6-b2c5-ad32e5b4c5ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.473654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4f61e-b5d7-41a6-b2c5-ad32e5b4c5ea None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.493796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 320/656] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:28.494964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ca8f6-1c31-4903-8125-150ddf0e2ef9 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.495256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ca8f6-1c31-4903-8125-150ddf0e2ef9 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.495535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ca8f6-1c31-4903-8125-150ddf0e2ef9 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.501870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 321/657] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:28.505015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ca8f6-1c31-4903-8125-150ddf0e2ef9 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.525834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f24283-93b6-4053-9548-114d3e58dafe None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.530693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.565764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ef24d-d290-4a66-9588-1454d5ba149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.566447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef24d-d290-4a66-9588-1454d5ba149c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.566738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef24d-d290-4a66-9588-1454d5ba149c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.567014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef24d-d290-4a66-9588-1454d5ba149c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.619080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ca8f6-1c31-4903-8125-150ddf0e2ef9 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.639438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ef24d-d290-4a66-9588-1454d5ba149c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.640874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ef24d-d290-4a66-9588-1454d5ba149c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.655296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f466f4-5713-4cf4-8f63-f80bafc585b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.656175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f466f4-5713-4cf4-8f63-f80bafc585b1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.656529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f466f4-5713-4cf4-8f63-f80bafc585b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.656876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f466f4-5713-4cf4-8f63-f80bafc585b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.657159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.665132 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f466f4-5713-4cf4-8f63-f80bafc585b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.666685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f466f4-5713-4cf4-8f63-f80bafc585b1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-c7f466f4-5713-4cf4-8f63-f80bafc585b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:28.681855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:28.683042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 18:37:28.684197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:28.689782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 322/658] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:28.689782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f466f4-5713-4cf4-8f63-f80bafc585b1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.757020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 337/659] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:28.758395 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d95c54-af54-434e-95c3-50509bf03a6e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.758747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d95c54-af54-434e-95c3-50509bf03a6e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.759076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d95c54-af54-434e-95c3-50509bf03a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.776815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b3d95c54-af54-434e-95c3-50509bf03a6e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:28.778098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b3d95c54-af54-434e-95c3-50509bf03a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:28.779164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.803153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f466f4-5713-4cf4-8f63-f80bafc585b1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:28.843129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123c083-941b-49b5-a577-c729f12c60d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:28.844093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123c083-941b-49b5-a577-c729f12c60d6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:28.844500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123c083-941b-49b5-a577-c729f12c60d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:28.844922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123c083-941b-49b5-a577-c729f12c60d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:28.854441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 338/660] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:28.854441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d95c54-af54-434e-95c3-50509bf03a6e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:28.911149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.922535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123c083-941b-49b5-a577-c729f12c60d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:28.924442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123c083-941b-49b5-a577-c729f12c60d6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:28.967013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d95c54-af54-434e-95c3-50509bf03a6e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.004849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6183b0-854d-4e86-959f-dbd11d77307f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.005524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6183b0-854d-4e86-959f-dbd11d77307f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.005807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6183b0-854d-4e86-959f-dbd11d77307f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.006086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6183b0-854d-4e86-959f-dbd11d77307f None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.006953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6183b0-854d-4e86-959f-dbd11d77307f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:29.007266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6183b0-854d-4e86-959f-dbd11d77307f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.007917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.008786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6183b0-854d-4e86-959f-dbd11d77307f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.031039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 339/661] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:29.031039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6183b0-854d-4e86-959f-dbd11d77307f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.043356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 323/662] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:29.044237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123c083-941b-49b5-a577-c729f12c60d6 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.135724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6183b0-854d-4e86-959f-dbd11d77307f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.137475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.148042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123c083-941b-49b5-a577-c729f12c60d6 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.173805 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e66390-3b5d-481c-bf72-76d8a73a7de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.174623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e66390-3b5d-481c-bf72-76d8a73a7de8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.176408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e66390-3b5d-481c-bf72-76d8a73a7de8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.176701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e66390-3b5d-481c-bf72-76d8a73a7de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.184525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340d4c8-e50f-4ec0-8407-7f15d6d81407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.185323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340d4c8-e50f-4ec0-8407-7f15d6d81407 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.185609 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340d4c8-e50f-4ec0-8407-7f15d6d81407 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.186140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340d4c8-e50f-4ec0-8407-7f15d6d81407 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.190363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e66390-3b5d-481c-bf72-76d8a73a7de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.192119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e66390-3b5d-481c-bf72-76d8a73a7de8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.196879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340d4c8-e50f-4ec0-8407-7f15d6d81407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-1340d4c8-e50f-4ec0-8407-7f15d6d81407 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:29.204626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:29.205541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 324/663] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:29.211731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340d4c8-e50f-4ec0-8407-7f15d6d81407 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-42e66390-3b5d-481c-bf72-76d8a73a7de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:29.212497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:29.213536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:29.216912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:29.216912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:29.216912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:29.216912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:29.216912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 340/664] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:29.216912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e66390-3b5d-481c-bf72-76d8a73a7de8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.264368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.325265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e66390-3b5d-481c-bf72-76d8a73a7de8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.328017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340d4c8-e50f-4ec0-8407-7f15d6d81407 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.360842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad6aa-4ac2-4dad-bda4-644e550de7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.362449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad6aa-4ac2-4dad-bda4-644e550de7a1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.362449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad6aa-4ac2-4dad-bda4-644e550de7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.362752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad6aa-4ac2-4dad-bda4-644e550de7a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.366922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913c73-5544-4420-980b-9f8e5b6d2553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.367578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913c73-5544-4420-980b-9f8e5b6d2553 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.367865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913c73-5544-4420-980b-9f8e5b6d2553 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.368141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913c73-5544-4420-980b-9f8e5b6d2553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.379258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ad6aa-4ac2-4dad-bda4-644e550de7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.381802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ad6aa-4ac2-4dad-bda4-644e550de7a1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e64ad6aa-4ac2-4dad-bda4-644e550de7a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:29.406078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:29.407039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:29.407929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:29.407929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:29.407929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:29.407929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:29.411440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 341/665] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:29.412397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad6aa-4ac2-4dad-bda4-644e550de7a1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.427023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.456693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913c73-5544-4420-980b-9f8e5b6d2553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.459204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913c73-5544-4420-980b-9f8e5b6d2553 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.539443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.571258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad6aa-4ac2-4dad-bda4-644e550de7a1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.575547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 325/666] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:29.576557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913c73-5544-4420-980b-9f8e5b6d2553 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.616804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bbf79-4fd9-466b-8d4b-9cb54ec324e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.617636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bbf79-4fd9-466b-8d4b-9cb54ec324e0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.618017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bbf79-4fd9-466b-8d4b-9cb54ec324e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.618402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bbf79-4fd9-466b-8d4b-9cb54ec324e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.619261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bbf79-4fd9-466b-8d4b-9cb54ec324e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:29.619760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bbf79-4fd9-466b-8d4b-9cb54ec324e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.621329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bbf79-4fd9-466b-8d4b-9cb54ec324e0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.631871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 342/667] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:29.637389 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bbf79-4fd9-466b-8d4b-9cb54ec324e0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.703394 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913c73-5544-4420-980b-9f8e5b6d2553 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.719774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.752925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b984c-8596-4f46-a4b0-de33587b974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.755045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b984c-8596-4f46-a4b0-de33587b974d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.755559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b984c-8596-4f46-a4b0-de33587b974d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.756484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b984c-8596-4f46-a4b0-de33587b974d None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.757702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b984c-8596-4f46-a4b0-de33587b974d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:29.758192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b984c-8596-4f46-a4b0-de33587b974d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.760487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b984c-8596-4f46-a4b0-de33587b974d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.762936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bbf79-4fd9-466b-8d4b-9cb54ec324e0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.771154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.780922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 326/668] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:29.781953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b984c-8596-4f46-a4b0-de33587b974d None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.814025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983703dc-5015-40ec-881c-64521149cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.814783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983703dc-5015-40ec-881c-64521149cc77 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.815064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983703dc-5015-40ec-881c-64521149cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.815333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983703dc-5015-40ec-881c-64521149cc77 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.816902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983703dc-5015-40ec-881c-64521149cc77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:29.817265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983703dc-5015-40ec-881c-64521149cc77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.820328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983703dc-5015-40ec-881c-64521149cc77 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.848521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 343/669] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:29.849299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983703dc-5015-40ec-881c-64521149cc77 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.905317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b984c-8596-4f46-a4b0-de33587b974d None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.943425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8adac2-91b6-471e-8b83-2504c53aaee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.945012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8adac2-91b6-471e-8b83-2504c53aaee8 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.945507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8adac2-91b6-471e-8b83-2504c53aaee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.946030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8adac2-91b6-471e-8b83-2504c53aaee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:29.950446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983703dc-5015-40ec-881c-64521149cc77 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:29.959040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8adac2-91b6-471e-8b83-2504c53aaee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:29.960956 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8adac2-91b6-471e-8b83-2504c53aaee8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-3d8adac2-91b6-471e-8b83-2504c53aaee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:29.978945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:29.979842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:29.980716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:29.980716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:29.980716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:29.980716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:29.980716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 327/670] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:29.980994 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8adac2-91b6-471e-8b83-2504c53aaee8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:29.982264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:29.991853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aff06-b8da-4106-87c8-5d23422230f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:29.992640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aff06-b8da-4106-87c8-5d23422230f4 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:29.992926 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aff06-b8da-4106-87c8-5d23422230f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:29.993199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aff06-b8da-4106-87c8-5d23422230f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.004871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974aff06-b8da-4106-87c8-5d23422230f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.006333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974aff06-b8da-4106-87c8-5d23422230f4 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-974aff06-b8da-4106-87c8-5d23422230f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:30.025154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:30.026062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:30.027313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:30.027313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:30.027313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:30.027313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:30.027313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 344/671] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:30.027313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aff06-b8da-4106-87c8-5d23422230f4 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.041358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.096531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8adac2-91b6-471e-8b83-2504c53aaee8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.133359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a1ca2-2412-437a-b9f0-fbaf6aff16b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.134067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a1ca2-2412-437a-b9f0-fbaf6aff16b4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.134172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aff06-b8da-4106-87c8-5d23422230f4 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.134350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a1ca2-2412-437a-b9f0-fbaf6aff16b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.134654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a1ca2-2412-437a-b9f0-fbaf6aff16b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.142571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a1ca2-2412-437a-b9f0-fbaf6aff16b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.144565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a1ca2-2412-437a-b9f0-fbaf6aff16b4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-470a1ca2-2412-437a-b9f0-fbaf6aff16b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:30.158854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:30.160435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:30.161314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:30.161314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:30.161314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:30.161314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:30.161314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:30.161314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:30.161314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.161314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:30.161314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 328/672] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:30.161798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a1ca2-2412-437a-b9f0-fbaf6aff16b4 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.175059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab6f9-f27f-45bc-95bc-cefa47bc85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.175857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab6f9-f27f-45bc-95bc-cefa47bc85bb None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.176238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab6f9-f27f-45bc-95bc-cefa47bc85bb None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.176526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab6f9-f27f-45bc-95bc-cefa47bc85bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.183279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ab6f9-f27f-45bc-95bc-cefa47bc85bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.184707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ab6f9-f27f-45bc-95bc-cefa47bc85bb None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-c30ab6f9-f27f-45bc-95bc-cefa47bc85bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:30.199209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:30.200105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:30.200999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:30.200999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:30.200999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:30.200999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:30.200999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:30.200999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:30.200999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.200999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:30.200999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 345/673] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:30.201861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab6f9-f27f-45bc-95bc-cefa47bc85bb None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.248529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.284213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a1ca2-2412-437a-b9f0-fbaf6aff16b4 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.295533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.317075 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab6f9-f27f-45bc-95bc-cefa47bc85bb None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.320382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da409b-6df6-481c-ab82-d4cd8b7b16b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.321376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da409b-6df6-481c-ab82-d4cd8b7b16b8 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.321657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da409b-6df6-481c-ab82-d4cd8b7b16b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.321931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da409b-6df6-481c-ab82-d4cd8b7b16b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.322681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da409b-6df6-481c-ab82-d4cd8b7b16b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.322987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da409b-6df6-481c-ab82-d4cd8b7b16b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.324350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da409b-6df6-481c-ab82-d4cd8b7b16b8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.336402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 329/674] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.337208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da409b-6df6-481c-ab82-d4cd8b7b16b8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.358715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fbf8d-98d9-43cd-8c49-3c1ccb30964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.359802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fbf8d-98d9-43cd-8c49-3c1ccb30964d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.360082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fbf8d-98d9-43cd-8c49-3c1ccb30964d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.360363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fbf8d-98d9-43cd-8c49-3c1ccb30964d None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.361080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fbf8d-98d9-43cd-8c49-3c1ccb30964d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.361387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fbf8d-98d9-43cd-8c49-3c1ccb30964d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.362817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fbf8d-98d9-43cd-8c49-3c1ccb30964d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.379268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 346/675] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.379268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fbf8d-98d9-43cd-8c49-3c1ccb30964d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.445603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da409b-6df6-481c-ab82-d4cd8b7b16b8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.490744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.494272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fbf8d-98d9-43cd-8c49-3c1ccb30964d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.494647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a756d-dd06-4a89-9b9a-64cd2a355979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.495764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a756d-dd06-4a89-9b9a-64cd2a355979 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.496036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a756d-dd06-4a89-9b9a-64cd2a355979 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.496449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a756d-dd06-4a89-9b9a-64cd2a355979 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.497881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a756d-dd06-4a89-9b9a-64cd2a355979 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.499273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a756d-dd06-4a89-9b9a-64cd2a355979 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.501428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a756d-dd06-4a89-9b9a-64cd2a355979 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.518807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 330/676] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.519652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a756d-dd06-4a89-9b9a-64cd2a355979 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.539495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b04e9e-4819-4852-8346-4c42768174ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.540245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b04e9e-4819-4852-8346-4c42768174ab None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.540597 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b04e9e-4819-4852-8346-4c42768174ab None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.540900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b04e9e-4819-4852-8346-4c42768174ab None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.541892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b04e9e-4819-4852-8346-4c42768174ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.542282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b04e9e-4819-4852-8346-4c42768174ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.544166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b04e9e-4819-4852-8346-4c42768174ab None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.557962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.560009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 347/677] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.561200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b04e9e-4819-4852-8346-4c42768174ab None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.637565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a756d-dd06-4a89-9b9a-64cd2a355979 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.679444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfe410-2257-4fc8-933b-08ae3d55e631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.680332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfe410-2257-4fc8-933b-08ae3d55e631 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.680640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfe410-2257-4fc8-933b-08ae3d55e631 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.680957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfe410-2257-4fc8-933b-08ae3d55e631 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.689115 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfe410-2257-4fc8-933b-08ae3d55e631 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.691454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfe410-2257-4fc8-933b-08ae3d55e631 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.691586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b04e9e-4819-4852-8346-4c42768174ab None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-e9cfe410-2257-4fc8-933b-08ae3d55e631 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:30.705370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:30.706307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:30.707361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:30.707361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:30.707361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:30.707361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:30.707361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:30.707361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:30.707361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:30.707361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:30.707361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 331/678] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:30.708682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e4be3-ad8a-4fd2-81fb-c628532df7b7 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.708961 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e4be3-ad8a-4fd2-81fb-c628532df7b7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.709270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e4be3-ad8a-4fd2-81fb-c628532df7b7 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.710508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 332/679] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:30.711202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e4be3-ad8a-4fd2-81fb-c628532df7b7 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.739644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a1f21-953f-4e33-8230-c8b4e961a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.740444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a1f21-953f-4e33-8230-c8b4e961a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.740804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a1f21-953f-4e33-8230-c8b4e961a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.741057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a1f21-953f-4e33-8230-c8b4e961a4c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.748520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a1f21-953f-4e33-8230-c8b4e961a4c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.749966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a1f21-953f-4e33-8230-c8b4e961a4c9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-201a1f21-953f-4e33-8230-c8b4e961a4c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:30.765510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:30.766617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 348/680] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:30.767546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a1f21-953f-4e33-8230-c8b4e961a4c9 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.790407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.815489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.827256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e4be3-ad8a-4fd2-81fb-c628532df7b7 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.859958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c7da0-6669-45cd-b4ff-53a93c1a2eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.860607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c7da0-6669-45cd-b4ff-53a93c1a2eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.860890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c7da0-6669-45cd-b4ff-53a93c1a2eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.861166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c7da0-6669-45cd-b4ff-53a93c1a2eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.861990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c7da0-6669-45cd-b4ff-53a93c1a2eb9 None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=387fd99ff326463698bc32947ba25d77) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.862299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c7da0-6669-45cd-b4ff-53a93c1a2eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.864295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c7da0-6669-45cd-b4ff-53a93c1a2eb9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.868144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a1f21-953f-4e33-8230-c8b4e961a4c9 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:30.870022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 333/681] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/role_assignments?user.id=387fd99ff326463698bc32947ba25d77&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.870887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c7da0-6669-45cd-b4ff-53a93c1a2eb9 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:30.916825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eeab2-eeef-4fae-9fe8-ca79b159479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:30.917596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eeab2-eeef-4fae-9fe8-ca79b159479c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.917879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eeab2-eeef-4fae-9fe8-ca79b159479c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.918153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eeab2-eeef-4fae-9fe8-ca79b159479c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.919043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eeab2-eeef-4fae-9fe8-ca79b159479c None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=beb359ac9b084b38b77923219f42f655) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:30.919358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eeab2-eeef-4fae-9fe8-ca79b159479c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:30.920832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eeab2-eeef-4fae-9fe8-ca79b159479c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:30.938414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 349/682] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/role_assignments?user.id=beb359ac9b084b38b77923219f42f655&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:30.938414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b563e0-6b3d-4ec1-b9ee-885210602ddc None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:30.938414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b563e0-6b3d-4ec1-b9ee-885210602ddc None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:30.938414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b563e0-6b3d-4ec1-b9ee-885210602ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:30.948777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e0b563e0-6b3d-4ec1-b9ee-885210602ddc None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:30.950035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e0b563e0-6b3d-4ec1-b9ee-885210602ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:31.034801 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c7da0-6669-45cd-b4ff-53a93c1a2eb9 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.044122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 350/683] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:31.045014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b563e0-6b3d-4ec1-b9ee-885210602ddc None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.068948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.085498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60e0b1-16d7-4bd3-a5e3-27ade5d1d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.086207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60e0b1-16d7-4bd3-a5e3-27ade5d1d560 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.086534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60e0b1-16d7-4bd3-a5e3-27ade5d1d560 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.086812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60e0b1-16d7-4bd3-a5e3-27ade5d1d560 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.090579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60e0b1-16d7-4bd3-a5e3-27ade5d1d560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:31.090579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60e0b1-16d7-4bd3-a5e3-27ade5d1d560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.090579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60e0b1-16d7-4bd3-a5e3-27ade5d1d560 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.105641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 334/684] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:31.105850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60e0b1-16d7-4bd3-a5e3-27ade5d1d560 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.125849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.191873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b563e0-6b3d-4ec1-b9ee-885210602ddc None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.234921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005add-d7b9-4786-9a32-a673fde89e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.235138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60e0b1-16d7-4bd3-a5e3-27ade5d1d560 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.235590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005add-d7b9-4786-9a32-a673fde89e8d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.235869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005add-d7b9-4786-9a32-a673fde89e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.236141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57005add-d7b9-4786-9a32-a673fde89e8d None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.236981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57005add-d7b9-4786-9a32-a673fde89e8d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:31.237288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57005add-d7b9-4786-9a32-a673fde89e8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.240993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57005add-d7b9-4786-9a32-a673fde89e8d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.261902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 351/685] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:31.263787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005add-d7b9-4786-9a32-a673fde89e8d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.287527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d0eb6-1e49-401b-acc0-d3b800d5013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.288693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d0eb6-1e49-401b-acc0-d3b800d5013b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.289183 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d0eb6-1e49-401b-acc0-d3b800d5013b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.289677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d0eb6-1e49-401b-acc0-d3b800d5013b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.307265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d0eb6-1e49-401b-acc0-d3b800d5013b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-461d0eb6-1e49-401b-acc0-d3b800d5013b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:31.319071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:31.320145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:31.321539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 335/686] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:31.322256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d0eb6-1e49-401b-acc0-d3b800d5013b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.354790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.396779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57005add-d7b9-4786-9a32-a673fde89e8d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.410417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.441170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f2e8f-1d71-4120-ae7a-5482bbbc3b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.442408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f2e8f-1d71-4120-ae7a-5482bbbc3b0b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.442927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f2e8f-1d71-4120-ae7a-5482bbbc3b0b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.443575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f2e8f-1d71-4120-ae7a-5482bbbc3b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.444611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f2e8f-1d71-4120-ae7a-5482bbbc3b0b None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=e11a8567e1254a0080cbe74efe0127f5) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:31.445124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f2e8f-1d71-4120-ae7a-5482bbbc3b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.445649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d0eb6-1e49-401b-acc0-d3b800d5013b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.447130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f2e8f-1d71-4120-ae7a-5482bbbc3b0b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.454788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 352/687] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/role_assignments?user.id=e11a8567e1254a0080cbe74efe0127f5&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:31.456076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f2e8f-1d71-4120-ae7a-5482bbbc3b0b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.486743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56cdd-4e13-4461-9450-e965cc373d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.488417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56cdd-4e13-4461-9450-e965cc373d21 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.488910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56cdd-4e13-4461-9450-e965cc373d21 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.489398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56cdd-4e13-4461-9450-e965cc373d21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.589001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56cdd-4e13-4461-9450-e965cc373d21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.590405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56cdd-4e13-4461-9450-e965cc373d21 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.593270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f2e8f-1d71-4120-ae7a-5482bbbc3b0b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.632183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a55d7-bada-43de-b679-424556a58409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.633250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a55d7-bada-43de-b679-424556a58409 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.633736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a55d7-bada-43de-b679-424556a58409 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.634281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a55d7-bada-43de-b679-424556a58409 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.635319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a55d7-bada-43de-b679-424556a58409 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:31.635883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a55d7-bada-43de-b679-424556a58409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.637527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a55d7-bada-43de-b679-424556a58409 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.644928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.653612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 353/688] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:31.655114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a55d7-bada-43de-b679-424556a58409 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.724098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.778594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a55d7-bada-43de-b679-424556a58409 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.787084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 336/689] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:31.797103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56cdd-4e13-4461-9450-e965cc373d21 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.826864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550c675-9ff4-4cfe-b01e-431d149ce1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.827979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550c675-9ff4-4cfe-b01e-431d149ce1c6 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.828268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550c675-9ff4-4cfe-b01e-431d149ce1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.828548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550c675-9ff4-4cfe-b01e-431d149ce1c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.844829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550c675-9ff4-4cfe-b01e-431d149ce1c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.846185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550c675-9ff4-4cfe-b01e-431d149ce1c6 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-3550c675-9ff4-4cfe-b01e-431d149ce1c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:31.868533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:31.869630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:31.870721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:31.870721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:31.870721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:31.870721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:31.875027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 354/690] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:31.876855 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550c675-9ff4-4cfe-b01e-431d149ce1c6 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:31.933175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56cdd-4e13-4461-9450-e965cc373d21 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:31.944650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:31.979791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a796af-a275-4f8d-bc75-d10588edea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:31.980775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a796af-a275-4f8d-bc75-d10588edea28 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:31.981155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a796af-a275-4f8d-bc75-d10588edea28 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:31.981528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a796af-a275-4f8d-bc75-d10588edea28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:31.992654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a796af-a275-4f8d-bc75-d10588edea28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:31.994602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a796af-a275-4f8d-bc75-d10588edea28 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-73a796af-a275-4f8d-bc75-d10588edea28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:32.015583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:32.016715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:32.017784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:32.017784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:32.017784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:32.017784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:32.018726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550c675-9ff4-4cfe-b01e-431d149ce1c6 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.020032 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 337/691] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:32.025169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a796af-a275-4f8d-bc75-d10588edea28 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.062631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82932631-a3b1-49c6-89ea-16036d271350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.063652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82932631-a3b1-49c6-89ea-16036d271350 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.064844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82932631-a3b1-49c6-89ea-16036d271350 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.065266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82932631-a3b1-49c6-89ea-16036d271350 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.068099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82932631-a3b1-49c6-89ea-16036d271350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:32.068536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.069011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82932631-a3b1-49c6-89ea-16036d271350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:32.069936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82932631-a3b1-49c6-89ea-16036d271350 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.101155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 355/692] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:32.104496 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82932631-a3b1-49c6-89ea-16036d271350 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.198658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a796af-a275-4f8d-bc75-d10588edea28 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.266797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba261-4f23-47ec-828a-11a095916c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.267473 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba261-4f23-47ec-828a-11a095916c03 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.267754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba261-4f23-47ec-828a-11a095916c03 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.268027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba261-4f23-47ec-828a-11a095916c03 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.268760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfba261-4f23-47ec-828a-11a095916c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:32.269104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfba261-4f23-47ec-828a-11a095916c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:32.270501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfba261-4f23-47ec-828a-11a095916c03 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.301550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 338/693] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:32.308663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba261-4f23-47ec-828a-11a095916c03 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.351369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82932631-a3b1-49c6-89ea-16036d271350 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.380721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.438598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea7eb1-47e5-4636-adb7-a3eb87976ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.439402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea7eb1-47e5-4636-adb7-a3eb87976ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.439685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea7eb1-47e5-4636-adb7-a3eb87976ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.439963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea7eb1-47e5-4636-adb7-a3eb87976ca5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.455943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea7eb1-47e5-4636-adb7-a3eb87976ca5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:32.458921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea7eb1-47e5-4636-adb7-a3eb87976ca5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-3eea7eb1-47e5-4636-adb7-a3eb87976ca5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:32.489407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:32.490442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:32.491394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:32.497687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 356/694] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:32.503082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea7eb1-47e5-4636-adb7-a3eb87976ca5 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.522808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.539863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba261-4f23-47ec-828a-11a095916c03 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.615790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9a5ec-0e6a-4a81-8079-98398d470210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.616513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9a5ec-0e6a-4a81-8079-98398d470210 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.616794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9a5ec-0e6a-4a81-8079-98398d470210 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.617066 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9a5ec-0e6a-4a81-8079-98398d470210 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.630527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9a5ec-0e6a-4a81-8079-98398d470210 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:32.631981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9a5ec-0e6a-4a81-8079-98398d470210 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-40d9a5ec-0e6a-4a81-8079-98398d470210 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:32.665250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:32.666245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:32.667177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:32.667177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:32.667177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:32.667177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:32.667177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:32.667177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:32.667177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:32.667177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:32.669159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 339/695] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:32.671852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9a5ec-0e6a-4a81-8079-98398d470210 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.760309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea7eb1-47e5-4636-adb7-a3eb87976ca5 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.781671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9a5ec-0e6a-4a81-8079-98398d470210 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:32.819298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893a4fd-84d3-4c36-ba58-d26bb3886178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.819964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893a4fd-84d3-4c36-ba58-d26bb3886178 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.820247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893a4fd-84d3-4c36-ba58-d26bb3886178 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.820525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893a4fd-84d3-4c36-ba58-d26bb3886178 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.821319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893a4fd-84d3-4c36-ba58-d26bb3886178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:32.821628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893a4fd-84d3-4c36-ba58-d26bb3886178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:32.823106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893a4fd-84d3-4c36-ba58-d26bb3886178 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.836182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 340/696] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:32.845037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893a4fd-84d3-4c36-ba58-d26bb3886178 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.860554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.867393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e3ecd-51ea-4b6b-924d-ab38fdd3f8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:32.867998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3ecd-51ea-4b6b-924d-ab38fdd3f8ac None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:32.868447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3ecd-51ea-4b6b-924d-ab38fdd3f8ac None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:32.868728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3ecd-51ea-4b6b-924d-ab38fdd3f8ac None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:32.869573 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e3ecd-51ea-4b6b-924d-ab38fdd3f8ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:32.869881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e3ecd-51ea-4b6b-924d-ab38fdd3f8ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:32.871329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e3ecd-51ea-4b6b-924d-ab38fdd3f8ac None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:32.902436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 357/697] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:32.911543 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e3ecd-51ea-4b6b-924d-ab38fdd3f8ac None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:32.966745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.055337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893a4fd-84d3-4c36-ba58-d26bb3886178 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.093363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e3ecd-51ea-4b6b-924d-ab38fdd3f8ac None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.128773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214ac10-f0b5-45e8-8634-a09cb2686fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.129413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214ac10-f0b5-45e8-8634-a09cb2686fb6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.129622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214ac10-f0b5-45e8-8634-a09cb2686fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.129896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214ac10-f0b5-45e8-8634-a09cb2686fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.130762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214ac10-f0b5-45e8-8634-a09cb2686fb6 None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=f7da017f9a5b4bfcb5b97b5310e0a146) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:33.131072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214ac10-f0b5-45e8-8634-a09cb2686fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.132573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214ac10-f0b5-45e8-8634-a09cb2686fb6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.149985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 341/698] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/role_assignments?user.id=f7da017f9a5b4bfcb5b97b5310e0a146&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:33.153576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9632047-9087-4a97-acbc-1215a4b8d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.154324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9632047-9087-4a97-acbc-1215a4b8d96c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.154688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9632047-9087-4a97-acbc-1215a4b8d96c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.155021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9632047-9087-4a97-acbc-1215a4b8d96c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.270674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9632047-9087-4a97-acbc-1215a4b8d96c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.272380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9632047-9087-4a97-acbc-1215a4b8d96c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.321167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.411023 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a728e96-2f6c-4899-9903-394b69039fa7 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.411349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a728e96-2f6c-4899-9903-394b69039fa7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.411573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a728e96-2f6c-4899-9903-394b69039fa7 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.413473 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 342/699] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:33.418664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 358/700] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:33.420719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7c0f8-cfd0-4e87-9926-5d0fdf206a06 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.421039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7c0f8-cfd0-4e87-9926-5d0fdf206a06 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.421349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7c0f8-cfd0-4e87-9926-5d0fdf206a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.426434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9632047-9087-4a97-acbc-1215a4b8d96c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.444164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-6de7c0f8-cfd0-4e87-9926-5d0fdf206a06 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:33.445541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6de7c0f8-cfd0-4e87-9926-5d0fdf206a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:33.531853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.543604 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 343/701] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:33.552700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9632047-9087-4a97-acbc-1215a4b8d96c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.558280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cf94f-2b37-4e01-b0a9-b3c1dae83afb None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.558875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cf94f-2b37-4e01-b0a9-b3c1dae83afb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.559371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cf94f-2b37-4e01-b0a9-b3c1dae83afb None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.561450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 344/702] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:33.567306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe9c79-cd63-4d81-8883-177ee128bb2e None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.567595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe9c79-cd63-4d81-8883-177ee128bb2e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.567869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe9c79-cd63-4d81-8883-177ee128bb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.583948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.594471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7cbe9c79-cd63-4d81-8883-177ee128bb2e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:33.596315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7cbe9c79-cd63-4d81-8883-177ee128bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:33.598976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec163-fa88-4d6d-90c4-0cba4bb60724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.599717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec163-fa88-4d6d-90c4-0cba4bb60724 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.599998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec163-fa88-4d6d-90c4-0cba4bb60724 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.600276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec163-fa88-4d6d-90c4-0cba4bb60724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.613180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ec163-fa88-4d6d-90c4-0cba4bb60724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.615177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ec163-fa88-4d6d-90c4-0cba4bb60724 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-397ec163-fa88-4d6d-90c4-0cba4bb60724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:33.634834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:33.635769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:33.636773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:33.636773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:33.636773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:33.636773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:33.639144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 359/703] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:33.640159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec163-fa88-4d6d-90c4-0cba4bb60724 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.666089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 345/704] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:33.666891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe9c79-cd63-4d81-8883-177ee128bb2e None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.768304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec163-fa88-4d6d-90c4-0cba4bb60724 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.768964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe9c79-cd63-4d81-8883-177ee128bb2e None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.799584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.806963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac955b-9517-4521-8ecf-125f4ae392b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.807687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac955b-9517-4521-8ecf-125f4ae392b9 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.807966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac955b-9517-4521-8ecf-125f4ae392b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.808231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347444af-e0ed-4e93-9542-94334661dc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.808347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac955b-9517-4521-8ecf-125f4ae392b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.809001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac955b-9517-4521-8ecf-125f4ae392b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:33.809309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac955b-9517-4521-8ecf-125f4ae392b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.809765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347444af-e0ed-4e93-9542-94334661dc29 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.810230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347444af-e0ed-4e93-9542-94334661dc29 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.810721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac955b-9517-4521-8ecf-125f4ae392b9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.810825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347444af-e0ed-4e93-9542-94334661dc29 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:33.811911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347444af-e0ed-4e93-9542-94334661dc29 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:33.813688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347444af-e0ed-4e93-9542-94334661dc29 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:33.825546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 346/705] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:33.826415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac955b-9517-4521-8ecf-125f4ae392b9 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-347444af-e0ed-4e93-9542-94334661dc29 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:33.829426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:33.830361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:33.832053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:33.834709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 360/706] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:33.835722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347444af-e0ed-4e93-9542-94334661dc29 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:33.901836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:33.947225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac955b-9517-4521-8ecf-125f4ae392b9 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.968880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347444af-e0ed-4e93-9542-94334661dc29 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:33.990788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961869d6-10b2-4d54-8fc9-d33b4f8e97cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:33.992103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961869d6-10b2-4d54-8fc9-d33b4f8e97cd None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:33.992888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961869d6-10b2-4d54-8fc9-d33b4f8e97cd None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:33.993636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961869d6-10b2-4d54-8fc9-d33b4f8e97cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.003093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4845e4-055f-4507-8eae-b4b46c6acde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.004006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4845e4-055f-4507-8eae-b4b46c6acde9 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.004288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4845e4-055f-4507-8eae-b4b46c6acde9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.004563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4845e4-055f-4507-8eae-b4b46c6acde9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.009491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961869d6-10b2-4d54-8fc9-d33b4f8e97cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.011010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961869d6-10b2-4d54-8fc9-d33b4f8e97cd None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.015097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4845e4-055f-4507-8eae-b4b46c6acde9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.016840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4845e4-055f-4507-8eae-b4b46c6acde9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-961869d6-10b2-4d54-8fc9-d33b4f8e97cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:34.030529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.031539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.032470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:34.032470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:34.032470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:34.032470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:34.032470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 347/707] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.033240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961869d6-10b2-4d54-8fc9-d33b4f8e97cd None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-aa4845e4-055f-4507-8eae-b4b46c6acde9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:34.040246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.041232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.042170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:34.042170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:34.042170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:34.042170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:34.042170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:34.042170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:34.042170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:34.042170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:34.044246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 361/708] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.045407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4845e4-055f-4507-8eae-b4b46c6acde9 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.089676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.153868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961869d6-10b2-4d54-8fc9-d33b4f8e97cd None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.173182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4845e4-055f-4507-8eae-b4b46c6acde9 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.177825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.204026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557173b-8636-454b-83c4-983de6b97892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.204707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557173b-8636-454b-83c4-983de6b97892 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.204990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557173b-8636-454b-83c4-983de6b97892 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.205265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557173b-8636-454b-83c4-983de6b97892 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.208163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557173b-8636-454b-83c4-983de6b97892 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:34.208688 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557173b-8636-454b-83c4-983de6b97892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.210596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557173b-8636-454b-83c4-983de6b97892 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.221482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 348/709] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:34.221482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557173b-8636-454b-83c4-983de6b97892 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.228363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d22180-db86-4d77-ae6f-258114a974bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.229032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d22180-db86-4d77-ae6f-258114a974bc None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.229315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d22180-db86-4d77-ae6f-258114a974bc None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.229591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d22180-db86-4d77-ae6f-258114a974bc None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.230323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d22180-db86-4d77-ae6f-258114a974bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:34.230690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d22180-db86-4d77-ae6f-258114a974bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.232181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d22180-db86-4d77-ae6f-258114a974bc None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.244754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 362/710] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:34.245849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d22180-db86-4d77-ae6f-258114a974bc None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.333826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557173b-8636-454b-83c4-983de6b97892 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.340792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.350788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d22180-db86-4d77-ae6f-258114a974bc None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.372413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaa93d-c668-4fcb-a297-1a064841c890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.373070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa93d-c668-4fcb-a297-1a064841c890 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.373346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa93d-c668-4fcb-a297-1a064841c890 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.373617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa93d-c668-4fcb-a297-1a064841c890 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.374406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaa93d-c668-4fcb-a297-1a064841c890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:34.374721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaa93d-c668-4fcb-a297-1a064841c890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.376150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaa93d-c668-4fcb-a297-1a064841c890 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.386154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f9fd-f909-4725-82c3-f61c640436f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.387064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f9fd-f909-4725-82c3-f61c640436f4 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.387493 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f9fd-f909-4725-82c3-f61c640436f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.387945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f9fd-f909-4725-82c3-f61c640436f4 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.388804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f9fd-f909-4725-82c3-f61c640436f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:34.388939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 349/711] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:34.389384 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f9fd-f909-4725-82c3-f61c640436f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.390171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a6a62-7988-479d-89e7-75e5d445c2f6 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.390480 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a6a62-7988-479d-89e7-75e5d445c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.390754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a6a62-7988-479d-89e7-75e5d445c2f6 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.391345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f9fd-f909-4725-82c3-f61c640436f4 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.396278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 350/712] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:34.396278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a6a62-7988-479d-89e7-75e5d445c2f6 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.402963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 363/713] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:34.403921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f9fd-f909-4725-82c3-f61c640436f4 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.436778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.517801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f9fd-f909-4725-82c3-f61c640436f4 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.530485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a6a62-7988-479d-89e7-75e5d445c2f6 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.556347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6115d-f891-4c15-95a8-11b487c7ba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.557264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6115d-f891-4c15-95a8-11b487c7ba67 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.557695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6115d-f891-4c15-95a8-11b487c7ba67 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.558140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6115d-f891-4c15-95a8-11b487c7ba67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.559166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6115d-f891-4c15-95a8-11b487c7ba67 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6cba70fa423e413a9222021116ff5718) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:34.559626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6115d-f891-4c15-95a8-11b487c7ba67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.561500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6115d-f891-4c15-95a8-11b487c7ba67 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.570195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 364/714] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/role_assignments?user.id=6cba70fa423e413a9222021116ff5718&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:34.571872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce61bb-2e34-42cd-8a71-940c4c84806c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.572155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce61bb-2e34-42cd-8a71-940c4c84806c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.572434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce61bb-2e34-42cd-8a71-940c4c84806c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.584091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89293a9-9a13-4309-950d-3babbb2d1aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.584783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89293a9-9a13-4309-950d-3babbb2d1aeb None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.585070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89293a9-9a13-4309-950d-3babbb2d1aeb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.585351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89293a9-9a13-4309-950d-3babbb2d1aeb None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.586061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89293a9-9a13-4309-950d-3babbb2d1aeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.587554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89293a9-9a13-4309-950d-3babbb2d1aeb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.592440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3cce61bb-2e34-42cd-8a71-940c4c84806c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:34.592440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3cce61bb-2e34-42cd-8a71-940c4c84806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:34.637121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 351/715] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:37:34 2022] POST /identity/v3/users => generated 254 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:34.678672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 365/716] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:34.713926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89293a9-9a13-4309-950d-3babbb2d1aeb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.755667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:34.860947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89293a9-9a13-4309-950d-3babbb2d1aeb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:34.899027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d42e0-b901-4db3-8b96-3f8c0c381ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:34.900073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d42e0-b901-4db3-8b96-3f8c0c381ddf None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:34.900504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d42e0-b901-4db3-8b96-3f8c0c381ddf None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:34.900942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d42e0-b901-4db3-8b96-3f8c0c381ddf None admin] PATH_INFO: `/v3/services/network` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:34.901768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d42e0-b901-4db3-8b96-3f8c0c381ddf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:34.903323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d42e0-b901-4db3-8b96-3f8c0c381ddf None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-961d42e0-b901-4db3-8b96-3f8c0c381ddf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:34.917646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:34.918838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:34.919660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:34.926771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 352/717] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:34.926843 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce61bb-2e34-42cd-8a71-940c4c84806c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:34.954728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.036067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce61bb-2e34-42cd-8a71-940c4c84806c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.077579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437a8fc-8b9d-4abf-96df-e09881c49f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.078625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437a8fc-8b9d-4abf-96df-e09881c49f82 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.079132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437a8fc-8b9d-4abf-96df-e09881c49f82 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.079654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437a8fc-8b9d-4abf-96df-e09881c49f82 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.080564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437a8fc-8b9d-4abf-96df-e09881c49f82 None admin] RBAC: Adding query filter params (name=network) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:35.081093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437a8fc-8b9d-4abf-96df-e09881c49f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.083251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437a8fc-8b9d-4abf-96df-e09881c49f82 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.088622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 366/718] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:35.094334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d42e0-b901-4db3-8b96-3f8c0c381ddf None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:35.186406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.203904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d42e0-b901-4db3-8b96-3f8c0c381ddf None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:35.243094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e497-c615-4fc5-87f9-30087b55fbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:35.244199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e497-c615-4fc5-87f9-30087b55fbc4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.244730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e497-c615-4fc5-87f9-30087b55fbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.245227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e497-c615-4fc5-87f9-30087b55fbc4 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.246163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e497-c615-4fc5-87f9-30087b55fbc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:35.246729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e497-c615-4fc5-87f9-30087b55fbc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:35.249099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e497-c615-4fc5-87f9-30087b55fbc4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:35.256554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 353/719] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:35.827272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9bce2-6b32-44d4-b421-5b846eecee14 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.827912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9bce2-6b32-44d4-b421-5b846eecee14 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.828403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9bce2-6b32-44d4-b421-5b846eecee14 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.830192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 367/720] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:35.836608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bf590-43d4-4455-a2d2-ac3ef563cf37 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:35.837175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bf590-43d4-4455-a2d2-ac3ef563cf37 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:35.837669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bf590-43d4-4455-a2d2-ac3ef563cf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:35.855733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-3a2bf590-43d4-4455-a2d2-ac3ef563cf37 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:35.857291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-3a2bf590-43d4-4455-a2d2-ac3ef563cf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:35.938048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 354/721] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:35.962576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9bce2-6b32-44d4-b421-5b846eecee14 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.078737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.100401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9bce2-6b32-44d4-b421-5b846eecee14 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.145108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ef200-596a-4229-bc05-93c2476bc23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.146226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ef200-596a-4229-bc05-93c2476bc23f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.146703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ef200-596a-4229-bc05-93c2476bc23f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.147175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ef200-596a-4229-bc05-93c2476bc23f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.164140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ef200-596a-4229-bc05-93c2476bc23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-3e8ef200-596a-4229-bc05-93c2476bc23f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:36.172250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:36.173260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:36.174131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:36.176869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 368/722] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:36.186462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bf590-43d4-4455-a2d2-ac3ef563cf37 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.284226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.310850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bf590-43d4-4455-a2d2-ac3ef563cf37 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.353738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a5870-7c8b-46de-82d9-73994ed0ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.354666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a5870-7c8b-46de-82d9-73994ed0ce18 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.355095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a5870-7c8b-46de-82d9-73994ed0ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.355540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a5870-7c8b-46de-82d9-73994ed0ce18 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.356433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a5870-7c8b-46de-82d9-73994ed0ce18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:36.356883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a5870-7c8b-46de-82d9-73994ed0ce18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.358412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a5870-7c8b-46de-82d9-73994ed0ce18 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.368362 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 355/723] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:36.373943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ef200-596a-4229-bc05-93c2476bc23f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.505298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ef200-596a-4229-bc05-93c2476bc23f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.570967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8848d-2dd3-4c5c-82a0-bc11170a29fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.571770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8848d-2dd3-4c5c-82a0-bc11170a29fd None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.572056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8848d-2dd3-4c5c-82a0-bc11170a29fd None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.572339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8848d-2dd3-4c5c-82a0-bc11170a29fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.592307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8848d-2dd3-4c5c-82a0-bc11170a29fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.593735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8848d-2dd3-4c5c-82a0-bc11170a29fd None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.600791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-b4b8848d-2dd3-4c5c-82a0-bc11170a29fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:36.615874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:36.616729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:36.617708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:36.617708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:36.617708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:36.617708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:36.619947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 369/724] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:36.625058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a5870-7c8b-46de-82d9-73994ed0ce18 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.745983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a5870-7c8b-46de-82d9-73994ed0ce18 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:36.786417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26146d9-0450-49af-a2bc-80785a59c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:36.786417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26146d9-0450-49af-a2bc-80785a59c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.786417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26146d9-0450-49af-a2bc-80785a59c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.786417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26146d9-0450-49af-a2bc-80785a59c1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.788076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26146d9-0450-49af-a2bc-80785a59c1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:36.788076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26146d9-0450-49af-a2bc-80785a59c1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:36.788076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26146d9-0450-49af-a2bc-80785a59c1c4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:36.802744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 356/725] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:36.807975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8848d-2dd3-4c5c-82a0-bc11170a29fd None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:36.867490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a761094-6d02-436f-a1d5-fe67574f2e76 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.867789 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a761094-6d02-436f-a1d5-fe67574f2e76 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.867945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a761094-6d02-436f-a1d5-fe67574f2e76 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.869333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 357/726] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:36.874999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0af36-2d9d-4ff3-9065-8f90dd45973f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:36.875283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0af36-2d9d-4ff3-9065-8f90dd45973f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:36.875551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0af36-2d9d-4ff3-9065-8f90dd45973f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:36.880824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:36.894839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-42b0af36-2d9d-4ff3-9065-8f90dd45973f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:36.896049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-42b0af36-2d9d-4ff3-9065-8f90dd45973f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:36.998539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 358/727] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:36.998767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8848d-2dd3-4c5c-82a0-bc11170a29fd None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.014762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0af36-2d9d-4ff3-9065-8f90dd45973f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.073655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab80ffc-2d7f-4f10-b710-4385bdbd8b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.074488 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab80ffc-2d7f-4f10-b710-4385bdbd8b02 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.074781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab80ffc-2d7f-4f10-b710-4385bdbd8b02 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.075117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab80ffc-2d7f-4f10-b710-4385bdbd8b02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.098585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab80ffc-2d7f-4f10-b710-4385bdbd8b02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.100074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab80ffc-2d7f-4f10-b710-4385bdbd8b02 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-7ab80ffc-2d7f-4f10-b710-4385bdbd8b02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:37.123256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:37.124309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:37.125304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:37.127694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 370/728] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:37.134262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab80ffc-2d7f-4f10-b710-4385bdbd8b02 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.193645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0af36-2d9d-4ff3-9065-8f90dd45973f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.243701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.265281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.277979 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba782d-8a40-4d15-ac1d-214cd2ab79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.278687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba782d-8a40-4d15-ac1d-214cd2ab79f8 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.278972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba782d-8a40-4d15-ac1d-214cd2ab79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.279247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba782d-8a40-4d15-ac1d-214cd2ab79f8 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.279983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba782d-8a40-4d15-ac1d-214cd2ab79f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.281377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba782d-8a40-4d15-ac1d-214cd2ab79f8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.309250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 359/729] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:37:37 2022] POST /identity/v3/services => generated 251 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:37.311187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab80ffc-2d7f-4f10-b710-4385bdbd8b02 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.376955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d554e-15e7-4a4a-ad5c-9d5a1d2ac38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.377956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d554e-15e7-4a4a-ad5c-9d5a1d2ac38e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.378469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d554e-15e7-4a4a-ad5c-9d5a1d2ac38e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.378979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d554e-15e7-4a4a-ad5c-9d5a1d2ac38e None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.380013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d554e-15e7-4a4a-ad5c-9d5a1d2ac38e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:37.380494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d554e-15e7-4a4a-ad5c-9d5a1d2ac38e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.382215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d554e-15e7-4a4a-ad5c-9d5a1d2ac38e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.404615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 371/730] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:37.411644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba782d-8a40-4d15-ac1d-214cd2ab79f8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.566348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba782d-8a40-4d15-ac1d-214cd2ab79f8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.601826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f81bdf-8472-493a-baf3-4b142865cafd None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.602821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f81bdf-8472-493a-baf3-4b142865cafd None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.603593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39abbd-8ea8-47d6-8380-5e099029e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.603915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f81bdf-8472-493a-baf3-4b142865cafd None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.604263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39abbd-8ea8-47d6-8380-5e099029e993 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.604542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39abbd-8ea8-47d6-8380-5e099029e993 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.604819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39abbd-8ea8-47d6-8380-5e099029e993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.614961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 372/731] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:37 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:37.617623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169fa6-8b92-457f-a073-d899d0b08438 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.618532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169fa6-8b92-457f-a073-d899d0b08438 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.619306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45169fa6-8b92-457f-a073-d899d0b08438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.676629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.690419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39abbd-8ea8-47d6-8380-5e099029e993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.692144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39abbd-8ea8-47d6-8380-5e099029e993 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:37.763607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-45169fa6-8b92-457f-a073-d899d0b08438 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:37.765233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-45169fa6-8b92-457f-a073-d899d0b08438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:37.817249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 360/732] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:37.823385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39abbd-8ea8-47d6-8380-5e099029e993 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:37.847050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 373/733] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 18:37:37.849340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df85c-c54d-47f7-bfcd-750c8ad831a2 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.853953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df85c-c54d-47f7-bfcd-750c8ad831a2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.854526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df85c-c54d-47f7-bfcd-750c8ad831a2 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.856398 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 374/734] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:37.861504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdebdb-5eaa-440d-9226-fdb15728d8d6 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.862029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdebdb-5eaa-440d-9226-fdb15728d8d6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.862528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdebdb-5eaa-440d-9226-fdb15728d8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.895048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-67fdebdb-5eaa-440d-9226-fdb15728d8d6 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:37.896596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-67fdebdb-5eaa-440d-9226-fdb15728d8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:37.932841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.943265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39abbd-8ea8-47d6-8380-5e099029e993 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:37.945791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:37.981000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda728de-188f-491d-8b2b-ec5281b49d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:37.981819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda728de-188f-491d-8b2b-ec5281b49d51 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:37.982103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda728de-188f-491d-8b2b-ec5281b49d51 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:37.982372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda728de-188f-491d-8b2b-ec5281b49d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:37.993874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda728de-188f-491d-8b2b-ec5281b49d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:37.995364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda728de-188f-491d-8b2b-ec5281b49d51 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.000083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 375/735] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:38.001676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdebdb-5eaa-440d-9226-fdb15728d8d6 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-cda728de-188f-491d-8b2b-ec5281b49d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:38.015097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:38.016040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:38.016911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:38.016911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:38.016911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:38.016911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:38.016911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 361/736] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:38.022491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda728de-188f-491d-8b2b-ec5281b49d51 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.124375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdebdb-5eaa-440d-9226-fdb15728d8d6 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.149494 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda728de-188f-491d-8b2b-ec5281b49d51 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.160551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f434e-c296-49ba-9883-c269888571ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.161592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f434e-c296-49ba-9883-c269888571ec None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.162013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f434e-c296-49ba-9883-c269888571ec None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.162497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f434e-c296-49ba-9883-c269888571ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.174521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f434e-c296-49ba-9883-c269888571ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-fb5f434e-c296-49ba-9883-c269888571ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:38.183571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:38.184547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:38.185375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:38.188737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 376/737] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:38.189925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f434e-c296-49ba-9883-c269888571ec None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.198684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5708272-54fa-403b-a360-5eee4ef11259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.199540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5708272-54fa-403b-a360-5eee4ef11259 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.199893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5708272-54fa-403b-a360-5eee4ef11259 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.200277 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5708272-54fa-403b-a360-5eee4ef11259 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.201117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5708272-54fa-403b-a360-5eee4ef11259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:38.201497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5708272-54fa-403b-a360-5eee4ef11259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.203234 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5708272-54fa-403b-a360-5eee4ef11259 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.222888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 362/738] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:38.224094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5708272-54fa-403b-a360-5eee4ef11259 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.228203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.229736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.310736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f434e-c296-49ba-9883-c269888571ec None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.350815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a075-180d-447f-a079-feb8ce9a6bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.351634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a075-180d-447f-a079-feb8ce9a6bd8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.351914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a075-180d-447f-a079-feb8ce9a6bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.352389 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a075-180d-447f-a079-feb8ce9a6bd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.360166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5708272-54fa-403b-a360-5eee4ef11259 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.364546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a075-180d-447f-a079-feb8ce9a6bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-fc81a075-180d-447f-a079-feb8ce9a6bd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:38.373769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:38.374802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:38.375671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 377/739] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:38.376348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a075-180d-447f-a079-feb8ce9a6bd8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.407224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92513aa-311d-4b90-a383-1a1d9e37a8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.407893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92513aa-311d-4b90-a383-1a1d9e37a8db None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.408174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92513aa-311d-4b90-a383-1a1d9e37a8db None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.408449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92513aa-311d-4b90-a383-1a1d9e37a8db None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.409273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92513aa-311d-4b90-a383-1a1d9e37a8db None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:38.409578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92513aa-311d-4b90-a383-1a1d9e37a8db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.411651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92513aa-311d-4b90-a383-1a1d9e37a8db None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.422006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 363/740] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:38.423868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395e3a-2457-432c-a5b8-70bfe9c95557 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.424322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395e3a-2457-432c-a5b8-70bfe9c95557 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.424760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395e3a-2457-432c-a5b8-70bfe9c95557 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.426418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 364/741] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:38.431184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8395e3a-2457-432c-a5b8-70bfe9c95557 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.495483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.509442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a075-180d-447f-a079-feb8ce9a6bd8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.511859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.547813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb4595-cef9-420f-94ba-117260569171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.548610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4595-cef9-420f-94ba-117260569171 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.548888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4595-cef9-420f-94ba-117260569171 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.549311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4595-cef9-420f-94ba-117260569171 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.553076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8395e3a-2457-432c-a5b8-70bfe9c95557 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.556481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb4595-cef9-420f-94ba-117260569171 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.557961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb4595-cef9-420f-94ba-117260569171 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-bedb4595-cef9-420f-94ba-117260569171 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:38.572993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:38.574454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:38.575325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:38.575325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:38.575325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:38.575325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:38.575325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:38.575325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:38.575325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:38.575325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:38.579249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 378/742] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:38.580005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb4595-cef9-420f-94ba-117260569171 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.592367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c466-977e-4f4a-bb9e-83ae2c2506ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.593102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c466-977e-4f4a-bb9e-83ae2c2506ad None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.593387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c466-977e-4f4a-bb9e-83ae2c2506ad None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.593671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c466-977e-4f4a-bb9e-83ae2c2506ad None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.594482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c466-977e-4f4a-bb9e-83ae2c2506ad None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:38.594796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c466-977e-4f4a-bb9e-83ae2c2506ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.596179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c466-977e-4f4a-bb9e-83ae2c2506ad None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.608139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 365/743] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:38.609793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1f7de-60d4-4b6a-9a57-eb1a9a49a862 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.610087 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1f7de-60d4-4b6a-9a57-eb1a9a49a862 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.610372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1f7de-60d4-4b6a-9a57-eb1a9a49a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.627353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-76b1f7de-60d4-4b6a-9a57-eb1a9a49a862 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:38.628573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-76b1f7de-60d4-4b6a-9a57-eb1a9a49a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:38.712670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 366/744] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:38.713543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1f7de-60d4-4b6a-9a57-eb1a9a49a862 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.726650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb4595-cef9-420f-94ba-117260569171 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.777646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0865ec4-a682-4ece-9c84-6526f891dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.778800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0865ec4-a682-4ece-9c84-6526f891dda2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.779224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0865ec4-a682-4ece-9c84-6526f891dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.779665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0865ec4-a682-4ece-9c84-6526f891dda2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.780849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.796358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0865ec4-a682-4ece-9c84-6526f891dda2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.796358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0865ec4-a682-4ece-9c84-6526f891dda2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-b0865ec4-a682-4ece-9c84-6526f891dda2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:38.817203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:38.818174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:38.819093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:38.819093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:38.819093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:38.819093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:38.819093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 379/745] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:38.819379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0865ec4-a682-4ece-9c84-6526f891dda2 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.827400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:38.839340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1f7de-60d4-4b6a-9a57-eb1a9a49a862 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.884457 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e5ab-dac5-4386-992d-e7bb9ddf4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.885404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e5ab-dac5-4386-992d-e7bb9ddf4c81 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.885833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e5ab-dac5-4386-992d-e7bb9ddf4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.886254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e5ab-dac5-4386-992d-e7bb9ddf4c81 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.887347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e5ab-dac5-4386-992d-e7bb9ddf4c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:38.887803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e5ab-dac5-4386-992d-e7bb9ddf4c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:38.889498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e5ab-dac5-4386-992d-e7bb9ddf4c81 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:38.909321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 367/746] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:38.910218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e5ab-dac5-4386-992d-e7bb9ddf4c81 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:38.947538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0865ec4-a682-4ece-9c84-6526f891dda2 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:38.984809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a0d7-85e3-4533-aa9f-9701569d8ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:38.985608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a0d7-85e3-4533-aa9f-9701569d8ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:38.985889 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a0d7-85e3-4533-aa9f-9701569d8ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:38.986163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4a0d7-85e3-4533-aa9f-9701569d8ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:38.998722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a0d7-85e3-4533-aa9f-9701569d8ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.000219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4a0d7-85e3-4533-aa9f-9701569d8ba8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-86f4a0d7-85e3-4533-aa9f-9701569d8ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:39.018953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:39.020512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:39.021506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:39.021506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:39.021506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:39.021506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:39.021506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 380/747] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:39.021793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a0d7-85e3-4533-aa9f-9701569d8ba8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.043633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e5ab-dac5-4386-992d-e7bb9ddf4c81 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.065190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.086588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89b43-6df7-445b-9555-887c8169f93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.087523 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89b43-6df7-445b-9555-887c8169f93a None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.087810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89b43-6df7-445b-9555-887c8169f93a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.088091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89b43-6df7-445b-9555-887c8169f93a None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.088737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.088850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89b43-6df7-445b-9555-887c8169f93a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.090201 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89b43-6df7-445b-9555-887c8169f93a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.105434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 368/748] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:37:38 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:39.106616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89b43-6df7-445b-9555-887c8169f93a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.167319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4a0d7-85e3-4533-aa9f-9701569d8ba8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.226403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121979-20c4-413a-8408-f1c7815cd2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.227095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121979-20c4-413a-8408-f1c7815cd2ac None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.227380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121979-20c4-413a-8408-f1c7815cd2ac None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.227660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121979-20c4-413a-8408-f1c7815cd2ac None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.228742 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc121979-20c4-413a-8408-f1c7815cd2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:39.229054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc121979-20c4-413a-8408-f1c7815cd2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.230990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc121979-20c4-413a-8408-f1c7815cd2ac None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.254430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 381/749] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:39.254430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121979-20c4-413a-8408-f1c7815cd2ac None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.260787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89b43-6df7-445b-9555-887c8169f93a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.310019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2645d78-a1d9-42f6-8c11-a0cef50fead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.311114 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645d78-a1d9-42f6-8c11-a0cef50fead1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.311872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645d78-a1d9-42f6-8c11-a0cef50fead1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.312338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645d78-a1d9-42f6-8c11-a0cef50fead1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.313358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645d78-a1d9-42f6-8c11-a0cef50fead1 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=f7da017f9a5b4bfcb5b97b5310e0a146) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:39.313850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645d78-a1d9-42f6-8c11-a0cef50fead1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.315609 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645d78-a1d9-42f6-8c11-a0cef50fead1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.326434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 369/750] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/role_assignments?user.id=f7da017f9a5b4bfcb5b97b5310e0a146&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:39.326434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2645d78-a1d9-42f6-8c11-a0cef50fead1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.403698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.405022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121979-20c4-413a-8408-f1c7815cd2ac None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.422844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.452282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b6957-13ed-417d-855b-4c55bec11c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.453713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b6957-13ed-417d-855b-4c55bec11c37 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.454521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b6957-13ed-417d-855b-4c55bec11c37 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.454982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b6957-13ed-417d-855b-4c55bec11c37 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.456216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b6957-13ed-417d-855b-4c55bec11c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:39.456835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b6957-13ed-417d-855b-4c55bec11c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.458523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b6957-13ed-417d-855b-4c55bec11c37 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.474148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 382/751] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:39.479470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b6957-13ed-417d-855b-4c55bec11c37 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.493687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2645d78-a1d9-42f6-8c11-a0cef50fead1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.553158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c662f2-6e5c-479b-a76c-f03fdded2f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.554449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c662f2-6e5c-479b-a76c-f03fdded2f92 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.554944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c662f2-6e5c-479b-a76c-f03fdded2f92 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.555563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c662f2-6e5c-479b-a76c-f03fdded2f92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.566409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c662f2-6e5c-479b-a76c-f03fdded2f92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.568275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c662f2-6e5c-479b-a76c-f03fdded2f92 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-c7c662f2-6e5c-479b-a76c-f03fdded2f92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:39.584327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:39.585308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:39.586264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:39.589026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 370/752] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:39.594850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c662f2-6e5c-479b-a76c-f03fdded2f92 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.635296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b6957-13ed-417d-855b-4c55bec11c37 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.704861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118192e-a053-43e7-a2ed-6901acf8ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.705684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118192e-a053-43e7-a2ed-6901acf8ccda None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.705965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118192e-a053-43e7-a2ed-6901acf8ccda None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.706235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118192e-a053-43e7-a2ed-6901acf8ccda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.714793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c662f2-6e5c-479b-a76c-f03fdded2f92 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.716816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.718410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118192e-a053-43e7-a2ed-6901acf8ccda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.719869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118192e-a053-43e7-a2ed-6901acf8ccda None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-b118192e-a053-43e7-a2ed-6901acf8ccda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:39.754570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:39.755612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:39.756583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 383/753] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:39.761480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118192e-a053-43e7-a2ed-6901acf8ccda None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.768128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ca31d-4e1a-42f4-8177-de4fbc434525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.769372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ca31d-4e1a-42f4-8177-de4fbc434525 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.770228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ca31d-4e1a-42f4-8177-de4fbc434525 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.770806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ca31d-4e1a-42f4-8177-de4fbc434525 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.771978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ca31d-4e1a-42f4-8177-de4fbc434525 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:39.772510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ca31d-4e1a-42f4-8177-de4fbc434525 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.774236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ca31d-4e1a-42f4-8177-de4fbc434525 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:39.797978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 371/754] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:39.804697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ca31d-4e1a-42f4-8177-de4fbc434525 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:39.817153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:39.924855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ca31d-4e1a-42f4-8177-de4fbc434525 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:39.966593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05857f9c-ea0e-41ef-bf0a-2bf617de5b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:39.967782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05857f9c-ea0e-41ef-bf0a-2bf617de5b56 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:39.968273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05857f9c-ea0e-41ef-bf0a-2bf617de5b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:39.968748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05857f9c-ea0e-41ef-bf0a-2bf617de5b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:39.981077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05857f9c-ea0e-41ef-bf0a-2bf617de5b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:39.982929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05857f9c-ea0e-41ef-bf0a-2bf617de5b56 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.003046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118192e-a053-43e7-a2ed-6901acf8ccda None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-05857f9c-ea0e-41ef-bf0a-2bf617de5b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:40.004959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:40.005821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:40.006769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:40.006769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:40.006769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:40.006769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:40.007916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 372/755] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:40.013907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0225f32-744b-4341-a212-7dff898e4091 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.014256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0225f32-744b-4341-a212-7dff898e4091 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.014499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0225f32-744b-4341-a212-7dff898e4091 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.016102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 373/756] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:40.016968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0225f32-744b-4341-a212-7dff898e4091 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.037199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.058266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e62a2-3286-4aba-9661-40a22373c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.059078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e62a2-3286-4aba-9661-40a22373c644 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.059387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e62a2-3286-4aba-9661-40a22373c644 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.059780 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e62a2-3286-4aba-9661-40a22373c644 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.060647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e62a2-3286-4aba-9661-40a22373c644 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:40.060959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e62a2-3286-4aba-9661-40a22373c644 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.063472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e62a2-3286-4aba-9661-40a22373c644 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.090494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 384/757] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jun 16 18:37:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:40.092525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919fffe-c59c-46a0-a2bb-3fc38ddd8945 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.092813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919fffe-c59c-46a0-a2bb-3fc38ddd8945 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.093091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919fffe-c59c-46a0-a2bb-3fc38ddd8945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.118146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1919fffe-c59c-46a0-a2bb-3fc38ddd8945 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:40.119541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1919fffe-c59c-46a0-a2bb-3fc38ddd8945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:40.153216 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0225f32-744b-4341-a212-7dff898e4091 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.201440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc66b32-f81b-4eeb-a4ed-609395769e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.202552 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc66b32-f81b-4eeb-a4ed-609395769e55 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.203046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc66b32-f81b-4eeb-a4ed-609395769e55 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.203602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc66b32-f81b-4eeb-a4ed-609395769e55 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.204672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc66b32-f81b-4eeb-a4ed-609395769e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:40.205193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc66b32-f81b-4eeb-a4ed-609395769e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.207346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc66b32-f81b-4eeb-a4ed-609395769e55 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.209748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 385/758] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:40.210811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919fffe-c59c-46a0-a2bb-3fc38ddd8945 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.221988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 374/759] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:40.228375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc66b32-f81b-4eeb-a4ed-609395769e55 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.235973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.318432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.321319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919fffe-c59c-46a0-a2bb-3fc38ddd8945 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.356539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc66b32-f81b-4eeb-a4ed-609395769e55 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.357444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b004054-97b7-4dbd-b2de-8638dc296eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.358175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b004054-97b7-4dbd-b2de-8638dc296eea None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.358575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b004054-97b7-4dbd-b2de-8638dc296eea None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.359008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b004054-97b7-4dbd-b2de-8638dc296eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.397996 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed677a4-bfbb-4767-9999-e3ba71fb0ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.399079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed677a4-bfbb-4767-9999-e3ba71fb0ea1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.399512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed677a4-bfbb-4767-9999-e3ba71fb0ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.399967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed677a4-bfbb-4767-9999-e3ba71fb0ea1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.408368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed677a4-bfbb-4767-9999-e3ba71fb0ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.410075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed677a4-bfbb-4767-9999-e3ba71fb0ea1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-4ed677a4-bfbb-4767-9999-e3ba71fb0ea1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:40.426962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:40.428145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:40.429257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:40.429257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:40.429257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:40.429257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:40.429257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:40.429257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:40.429257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:40.429257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:40.436326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b004054-97b7-4dbd-b2de-8638dc296eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.436326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b004054-97b7-4dbd-b2de-8638dc296eea None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.436949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 375/760] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:40.438244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed677a4-bfbb-4767-9999-e3ba71fb0ea1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.458795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.549844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 386/761] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:37:40.550946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b004054-97b7-4dbd-b2de-8638dc296eea None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.561336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed677a4-bfbb-4767-9999-e3ba71fb0ea1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.596947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.604187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024c235-631c-4624-b733-5093a92b84fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.605219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c235-631c-4624-b733-5093a92b84fb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.605680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c235-631c-4624-b733-5093a92b84fb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.606214 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c235-631c-4624-b733-5093a92b84fb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.607142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024c235-631c-4624-b733-5093a92b84fb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.609062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024c235-631c-4624-b733-5093a92b84fb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-4024c235-631c-4624-b733-5093a92b84fb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:40.623810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:40.624799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:40.625627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:40.629230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 376/762] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:40.630222 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024c235-631c-4624-b733-5093a92b84fb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.660902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b004054-97b7-4dbd-b2de-8638dc296eea None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.681749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.697989 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcae6d1-cc33-4b90-b1a3-cd2345847010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.698698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcae6d1-cc33-4b90-b1a3-cd2345847010 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.698980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcae6d1-cc33-4b90-b1a3-cd2345847010 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.699247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcae6d1-cc33-4b90-b1a3-cd2345847010 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.700070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcae6d1-cc33-4b90-b1a3-cd2345847010 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:40.700378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcae6d1-cc33-4b90-b1a3-cd2345847010 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.701887 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcae6d1-cc33-4b90-b1a3-cd2345847010 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.719650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 387/763] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:40.719650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcae6d1-cc33-4b90-b1a3-cd2345847010 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.757942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024c235-631c-4624-b733-5093a92b84fb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.801285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e813f-36e2-4dce-93c4-a4c11c6a4186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.802085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e813f-36e2-4dce-93c4-a4c11c6a4186 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.802362 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e813f-36e2-4dce-93c4-a4c11c6a4186 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.802666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e813f-36e2-4dce-93c4-a4c11c6a4186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.815125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e813f-36e2-4dce-93c4-a4c11c6a4186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.816757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e813f-36e2-4dce-93c4-a4c11c6a4186 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-2b7e813f-36e2-4dce-93c4-a4c11c6a4186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:40.836807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:40.837786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:40.838718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:40.838718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:40.838718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:40.838718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:40.838718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 377/764] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:40.839228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e813f-36e2-4dce-93c4-a4c11c6a4186 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.842732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcae6d1-cc33-4b90-b1a3-cd2345847010 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:40.892465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111f6c-0cb2-4c40-ade3-67eddd677cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:40.894101 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111f6c-0cb2-4c40-ade3-67eddd677cbd None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:40.894600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111f6c-0cb2-4c40-ade3-67eddd677cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:40.895319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111f6c-0cb2-4c40-ade3-67eddd677cbd None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:40.896190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0111f6c-0cb2-4c40-ade3-67eddd677cbd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:40.896755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.898304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0111f6c-0cb2-4c40-ade3-67eddd677cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:40.899956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0111f6c-0cb2-4c40-ade3-67eddd677cbd None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:40.907038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 388/765] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:40.908393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111f6c-0cb2-4c40-ade3-67eddd677cbd None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:40.964521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:40.965608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e813f-36e2-4dce-93c4-a4c11c6a4186 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.003858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a668-3935-49b2-a058-7b5583e4e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.004663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a668-3935-49b2-a058-7b5583e4e7b6 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.004958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a668-3935-49b2-a058-7b5583e4e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.005219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a668-3935-49b2-a058-7b5583e4e7b6 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6cba70fa423e413a9222021116ff5718/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.007372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0a668-3935-49b2-a058-7b5583e4e7b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=6cba70fa423e413a9222021116ff5718, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.008994 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0a668-3935-49b2-a058-7b5583e4e7b6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.035566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 378/766] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:40 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6cba70fa423e413a9222021116ff5718/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:41.035566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a668-3935-49b2-a058-7b5583e4e7b6 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.041269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111f6c-0cb2-4c40-ade3-67eddd677cbd None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.129984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e29a-eafa-41ea-b6ed-4b724eaf55a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.131163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e29a-eafa-41ea-b6ed-4b724eaf55a9 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.133914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e29a-eafa-41ea-b6ed-4b724eaf55a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.134502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e29a-eafa-41ea-b6ed-4b724eaf55a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.135551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09e29a-eafa-41ea-b6ed-4b724eaf55a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:41.136078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09e29a-eafa-41ea-b6ed-4b724eaf55a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.139686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09e29a-eafa-41ea-b6ed-4b724eaf55a9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.158578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 389/767] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:41.164372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e29a-eafa-41ea-b6ed-4b724eaf55a9 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.271165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a668-3935-49b2-a058-7b5583e4e7b6 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.285475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e29a-eafa-41ea-b6ed-4b724eaf55a9 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.288751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.289879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.334430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e568dd-1adb-416c-a618-2431b6a5acd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.335062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e568dd-1adb-416c-a618-2431b6a5acd1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.335335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e568dd-1adb-416c-a618-2431b6a5acd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.335608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e568dd-1adb-416c-a618-2431b6a5acd1 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.336447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9b7a9-bd7a-4047-9ce5-c33eefada012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.336594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e568dd-1adb-416c-a618-2431b6a5acd1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:41.336758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e568dd-1adb-416c-a618-2431b6a5acd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.337259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b7a9-bd7a-4047-9ce5-c33eefada012 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.337546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b7a9-bd7a-4047-9ce5-c33eefada012 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.337828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b7a9-bd7a-4047-9ce5-c33eefada012 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.338131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e568dd-1adb-416c-a618-2431b6a5acd1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.344255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 379/768] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:41.345501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9b7a9-bd7a-4047-9ce5-c33eefada012 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.347002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9b7a9-bd7a-4047-9ce5-c33eefada012 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.349987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e568dd-1adb-416c-a618-2431b6a5acd1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-b4c9b7a9-bd7a-4047-9ce5-c33eefada012 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:41.364128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:41.365069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:41.365968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:41.365968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:41.365968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:41.365968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:41.365968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:41.365968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:41.365968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:41.365968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:41.365968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 390/769] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:41.376043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9b7a9-bd7a-4047-9ce5-c33eefada012 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.481245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e568dd-1adb-416c-a618-2431b6a5acd1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.540739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0606c46-0ce4-4302-abc3-b69644b34345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.541428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606c46-0ce4-4302-abc3-b69644b34345 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.541722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606c46-0ce4-4302-abc3-b69644b34345 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.542005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606c46-0ce4-4302-abc3-b69644b34345 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.542973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0606c46-0ce4-4302-abc3-b69644b34345 None admin] RBAC: Adding query filter params (interface=public, service_id=66aac14aa59a40d099a067227a46471b, region_id=RegionOne) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:41.543357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0606c46-0ce4-4302-abc3-b69644b34345 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.544878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0606c46-0ce4-4302-abc3-b69644b34345 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.554017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 380/770] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/endpoints?service_id=66aac14aa59a40d099a067227a46471b&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:41.566192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0606c46-0ce4-4302-abc3-b69644b34345 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.573870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9b7a9-bd7a-4047-9ce5-c33eefada012 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.605867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.614966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4aa4-40c1-431a-aa49-f261efc876c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.616128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4aa4-40c1-431a-aa49-f261efc876c6 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.616617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4aa4-40c1-431a-aa49-f261efc876c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.617085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4aa4-40c1-431a-aa49-f261efc876c6 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.618081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e4aa4-40c1-431a-aa49-f261efc876c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:41.618702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e4aa4-40c1-431a-aa49-f261efc876c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.620497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e4aa4-40c1-431a-aa49-f261efc876c6 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.634920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 391/771] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:41.636755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b05273-8bbd-4ed4-aef9-1566fc2f35d6 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.637245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b05273-8bbd-4ed4-aef9-1566fc2f35d6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.637712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b05273-8bbd-4ed4-aef9-1566fc2f35d6 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.643285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 392/772] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:41.644551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b05273-8bbd-4ed4-aef9-1566fc2f35d6 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:41.671945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:41.677563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0606c46-0ce4-4302-abc3-b69644b34345 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.714353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068d1e0-13f7-43ed-a549-c0ecb6903a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.715060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d1e0-13f7-43ed-a549-c0ecb6903a55 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.715353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d1e0-13f7-43ed-a549-c0ecb6903a55 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.715635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d1e0-13f7-43ed-a549-c0ecb6903a55 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.716329 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068d1e0-13f7-43ed-a549-c0ecb6903a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.717838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068d1e0-13f7-43ed-a549-c0ecb6903a55 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.726445 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 381/773] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:41.734713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aea14-e0c5-4435-a5dc-a04a844a17ee None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.734713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aea14-e0c5-4435-a5dc-a04a844a17ee None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.734713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aea14-e0c5-4435-a5dc-a04a844a17ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.765748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-230aea14-e0c5-4435-a5dc-a04a844a17ee None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:41.766998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-230aea14-e0c5-4435-a5dc-a04a844a17ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:41.813803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b05273-8bbd-4ed4-aef9-1566fc2f35d6 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:41.867835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db85be-9120-443a-b0a6-f6cbdad886d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:41.868559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db85be-9120-443a-b0a6-f6cbdad886d2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.868841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db85be-9120-443a-b0a6-f6cbdad886d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.870658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db85be-9120-443a-b0a6-f6cbdad886d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.871522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db85be-9120-443a-b0a6-f6cbdad886d2 None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6e8f3976dd524feeb4277e4ba4c8090b) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:41.871839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db85be-9120-443a-b0a6-f6cbdad886d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:41.876164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db85be-9120-443a-b0a6-f6cbdad886d2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:41.887382 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 393/774] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/role_assignments?user.id=6e8f3976dd524feeb4277e4ba4c8090b&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:41.889332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7298fb-9c91-4b69-b397-95764ff0cd83 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.889915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7298fb-9c91-4b69-b397-95764ff0cd83 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.890196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7298fb-9c91-4b69-b397-95764ff0cd83 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.892165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 394/775] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:41.900156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d195387-4696-4596-acad-2986315150d0 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:41.900526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d195387-4696-4596-acad-2986315150d0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:41.900867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d195387-4696-4596-acad-2986315150d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:41.923792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-7d195387-4696-4596-acad-2986315150d0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:41.923792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7d195387-4696-4596-acad-2986315150d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:41.929416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 382/776] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:41.961646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aea14-e0c5-4435-a5dc-a04a844a17ee None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.009733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.028868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 395/777] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:42.051547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d195387-4696-4596-acad-2986315150d0 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.091077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.134304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aea14-e0c5-4435-a5dc-a04a844a17ee None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.188400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9379-61bc-4ca0-8379-40f6c9b01a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.189220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9379-61bc-4ca0-8379-40f6c9b01a69 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.189505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9379-61bc-4ca0-8379-40f6c9b01a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.189781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9379-61bc-4ca0-8379-40f6c9b01a69 None admin] PATH_INFO: `/v3/services/network` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.190493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c9379-61bc-4ca0-8379-40f6c9b01a69 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.191945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c9379-61bc-4ca0-8379-40f6c9b01a69 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.216061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d195387-4696-4596-acad-2986315150d0 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-dd7c9379-61bc-4ca0-8379-40f6c9b01a69 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:42.217482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:42.218477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:42.219319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:42.224221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 383/778] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:41 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:42.225526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9379-61bc-4ca0-8379-40f6c9b01a69 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.253945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8fc94-02e2-4fba-b2d6-fe557bc8426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.254905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8fc94-02e2-4fba-b2d6-fe557bc8426e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.255191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8fc94-02e2-4fba-b2d6-fe557bc8426e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.255513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8fc94-02e2-4fba-b2d6-fe557bc8426e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.267485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8fc94-02e2-4fba-b2d6-fe557bc8426e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-84d8fc94-02e2-4fba-b2d6-fe557bc8426e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:42.277085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:42.279097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:42.280183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 396/779] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:42.294673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8fc94-02e2-4fba-b2d6-fe557bc8426e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.329503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.338023 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9379-61bc-4ca0-8379-40f6c9b01a69 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.376419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dbe13-406b-498c-8856-4e9b0445946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.377141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dbe13-406b-498c-8856-4e9b0445946f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.377476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dbe13-406b-498c-8856-4e9b0445946f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.377758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dbe13-406b-498c-8856-4e9b0445946f None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.378625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dbe13-406b-498c-8856-4e9b0445946f None admin] RBAC: Adding query filter params (name=network) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.378957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dbe13-406b-498c-8856-4e9b0445946f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.380437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dbe13-406b-498c-8856-4e9b0445946f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.389540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 384/780] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:42.391835 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dbe13-406b-498c-8856-4e9b0445946f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.410082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.444850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8fc94-02e2-4fba-b2d6-fe557bc8426e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.483693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641776-bcef-4d27-bfac-47c7333bec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.484464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641776-bcef-4d27-bfac-47c7333bec83 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.484766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641776-bcef-4d27-bfac-47c7333bec83 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.485006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641776-bcef-4d27-bfac-47c7333bec83 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.485762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67641776-bcef-4d27-bfac-47c7333bec83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.486067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67641776-bcef-4d27-bfac-47c7333bec83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.487561 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67641776-bcef-4d27-bfac-47c7333bec83 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.497373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 397/781] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:42.510424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dbe13-406b-498c-8856-4e9b0445946f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.510802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641776-bcef-4d27-bfac-47c7333bec83 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.545712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6df58-8ef0-47ee-8333-3fae70de19a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.546304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6df58-8ef0-47ee-8333-3fae70de19a9 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.546610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6df58-8ef0-47ee-8333-3fae70de19a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.546886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6df58-8ef0-47ee-8333-3fae70de19a9 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.547606 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6df58-8ef0-47ee-8333-3fae70de19a9 None admin] RBAC: Adding query filter params (type=network) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.547918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6df58-8ef0-47ee-8333-3fae70de19a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.549316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6df58-8ef0-47ee-8333-3fae70de19a9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.562572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 385/782] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:42.569019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6df58-8ef0-47ee-8333-3fae70de19a9 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.622770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.731325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641776-bcef-4d27-bfac-47c7333bec83 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.772170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d7429-349a-427c-b963-ef1f93dbaf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.773084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d7429-349a-427c-b963-ef1f93dbaf43 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.774341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d7429-349a-427c-b963-ef1f93dbaf43 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.774341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d7429-349a-427c-b963-ef1f93dbaf43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.780042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6df58-8ef0-47ee-8333-3fae70de19a9 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:42.794782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.799485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d7429-349a-427c-b963-ef1f93dbaf43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.801005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d7429-349a-427c-b963-ef1f93dbaf43 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-038d7429-349a-427c-b963-ef1f93dbaf43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:42.837570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:42.838553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:42.839444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:42.839444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:42.839444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:42.839444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:42.839444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 398/783] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:42.844705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d7429-349a-427c-b963-ef1f93dbaf43 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.858359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6be322-524f-4dc9-a3ca-7bab8b0db5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:42.859107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6be322-524f-4dc9-a3ca-7bab8b0db5f7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:42.859395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6be322-524f-4dc9-a3ca-7bab8b0db5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:42.859664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6be322-524f-4dc9-a3ca-7bab8b0db5f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:42.860468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6be322-524f-4dc9-a3ca-7bab8b0db5f7 None admin] RBAC: Adding query filter params (interface=public, service_id=5a59a09b0b5442698fcf663f3ab25604, region_id=RegionOne) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:42.860781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6be322-524f-4dc9-a3ca-7bab8b0db5f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:42.866404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6be322-524f-4dc9-a3ca-7bab8b0db5f7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:42.873106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 386/784] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/endpoints?service_id=5a59a09b0b5442698fcf663f3ab25604&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:42.874367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6be322-524f-4dc9-a3ca-7bab8b0db5f7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:42.966442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:42.983430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6be322-524f-4dc9-a3ca-7bab8b0db5f7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.020953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69676c0a-8120-40d2-b2b0-df1bc5d92b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.021951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69676c0a-8120-40d2-b2b0-df1bc5d92b72 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.024555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69676c0a-8120-40d2-b2b0-df1bc5d92b72 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.024842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69676c0a-8120-40d2-b2b0-df1bc5d92b72 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.025546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69676c0a-8120-40d2-b2b0-df1bc5d92b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.030425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69676c0a-8120-40d2-b2b0-df1bc5d92b72 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.036048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 387/785] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:43.077692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d7429-349a-427c-b963-ef1f93dbaf43 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.118531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12846b1-b70e-4de8-aa22-b298b3c84414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.119515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12846b1-b70e-4de8-aa22-b298b3c84414 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.119974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12846b1-b70e-4de8-aa22-b298b3c84414 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.120421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12846b1-b70e-4de8-aa22-b298b3c84414 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.121348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12846b1-b70e-4de8-aa22-b298b3c84414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:43.121886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12846b1-b70e-4de8-aa22-b298b3c84414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.123647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12846b1-b70e-4de8-aa22-b298b3c84414 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.142795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 399/786] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:43.144666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69676c0a-8120-40d2-b2b0-df1bc5d92b72 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.269780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69676c0a-8120-40d2-b2b0-df1bc5d92b72 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.309043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac08da-9505-49ca-adec-63db71571f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.310170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac08da-9505-49ca-adec-63db71571f40 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.310677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac08da-9505-49ca-adec-63db71571f40 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.311153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac08da-9505-49ca-adec-63db71571f40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.321455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac08da-9505-49ca-adec-63db71571f40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.323223 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac08da-9505-49ca-adec-63db71571f40 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-e7ac08da-9505-49ca-adec-63db71571f40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:43.339109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:43.340514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:43.341441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:43.344032 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 388/787] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:43.350849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12846b1-b70e-4de8-aa22-b298b3c84414 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.406917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:43.462328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12846b1-b70e-4de8-aa22-b298b3c84414 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.514132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba71e8-8313-4505-8a40-f605ff1ba006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.514874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba71e8-8313-4505-8a40-f605ff1ba006 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.515159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba71e8-8313-4505-8a40-f605ff1ba006 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.515434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba71e8-8313-4505-8a40-f605ff1ba006 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.516281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba71e8-8313-4505-8a40-f605ff1ba006 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:43.516586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba71e8-8313-4505-8a40-f605ff1ba006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.518005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba71e8-8313-4505-8a40-f605ff1ba006 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.546102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 400/788] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:43.552743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac08da-9505-49ca-adec-63db71571f40 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.572750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:43.713920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac08da-9505-49ca-adec-63db71571f40 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.787531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d109444-02de-48ac-a21b-5f44f1bebdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:43.788621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d109444-02de-48ac-a21b-5f44f1bebdc4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.789048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d109444-02de-48ac-a21b-5f44f1bebdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.789488 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d109444-02de-48ac-a21b-5f44f1bebdc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.803298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d109444-02de-48ac-a21b-5f44f1bebdc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:43.805131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d109444-02de-48ac-a21b-5f44f1bebdc4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-0d109444-02de-48ac-a21b-5f44f1bebdc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:43.833039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:43.834151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:43.835342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:43.835342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:43.835342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:43.835342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:43.837217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 389/789] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:43.842836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba71e8-8313-4505-8a40-f605ff1ba006 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:43.845187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af2e62-90a5-43fa-8076-04627a1ae7dc None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.845623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af2e62-90a5-43fa-8076-04627a1ae7dc None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.846041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af2e62-90a5-43fa-8076-04627a1ae7dc None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.848363 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 390/790] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:43.865236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb258d-6d17-4d2e-9c06-d6a42227e96a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:43.865817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb258d-6d17-4d2e-9c06-d6a42227e96a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:43.866272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb258d-6d17-4d2e-9c06-d6a42227e96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:43.895284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c7eb258d-6d17-4d2e-9c06-d6a42227e96a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:43.896790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c7eb258d-6d17-4d2e-9c06-d6a42227e96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:43.966372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba71e8-8313-4505-8a40-f605ff1ba006 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:43.990798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.001519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66561f-2ed2-4a8c-97de-eda5a453067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.002199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66561f-2ed2-4a8c-97de-eda5a453067f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.002531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66561f-2ed2-4a8c-97de-eda5a453067f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.002816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66561f-2ed2-4a8c-97de-eda5a453067f None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.003549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66561f-2ed2-4a8c-97de-eda5a453067f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:44.004441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66561f-2ed2-4a8c-97de-eda5a453067f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.005947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66561f-2ed2-4a8c-97de-eda5a453067f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.016055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.030736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 401/791] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:44.031809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 391/792] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:44.036218 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66561f-2ed2-4a8c-97de-eda5a453067f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.061542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb258d-6d17-4d2e-9c06-d6a42227e96a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.220364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66561f-2ed2-4a8c-97de-eda5a453067f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.246474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb258d-6d17-4d2e-9c06-d6a42227e96a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.258583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180c1ab-8866-4c5b-962b-45829680aa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.259483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c1ab-8866-4c5b-962b-45829680aa77 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.259852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c1ab-8866-4c5b-962b-45829680aa77 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.260233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180c1ab-8866-4c5b-962b-45829680aa77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.268276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180c1ab-8866-4c5b-962b-45829680aa77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.270412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180c1ab-8866-4c5b-962b-45829680aa77 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-6180c1ab-8866-4c5b-962b-45829680aa77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:44.289991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:44.290958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:44.291856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:44.291856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:44.291856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:44.291856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:44.291856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:44.291856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:44.291856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:44.291856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:44.292279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4f20f-649e-4549-b14b-d25e6cb77e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.292279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4f20f-649e-4549-b14b-d25e6cb77e5e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.292279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4f20f-649e-4549-b14b-d25e6cb77e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.292279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4f20f-649e-4549-b14b-d25e6cb77e5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.295465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 402/793] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:44.296995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21c881-2bed-4971-b1e2-dfda0161fdb9 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.297445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21c881-2bed-4971-b1e2-dfda0161fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.297879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21c881-2bed-4971-b1e2-dfda0161fdb9 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.303501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 403/794] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:44.303501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21c881-2bed-4971-b1e2-dfda0161fdb9 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.313002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4f20f-649e-4549-b14b-d25e6cb77e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-89e4f20f-649e-4549-b14b-d25e6cb77e5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:44.322279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:44.323315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:44.324160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:44.328289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 392/795] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:44.329785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5e0ae-59e8-47bf-bfe6-2d41d68be8f7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.330081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5e0ae-59e8-47bf-bfe6-2d41d68be8f7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.330370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5e0ae-59e8-47bf-bfe6-2d41d68be8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.344460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.350929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-1fc5e0ae-59e8-47bf-bfe6-2d41d68be8f7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:44.352326 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1fc5e0ae-59e8-47bf-bfe6-2d41d68be8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:44.411340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.437509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21c881-2bed-4971-b1e2-dfda0161fdb9 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.445332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 393/796] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:44.445332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5e0ae-59e8-47bf-bfe6-2d41d68be8f7 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.501848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24755f-56a3-46b8-b6b5-f425ee4a8b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.502923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24755f-56a3-46b8-b6b5-f425ee4a8b5d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.503444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24755f-56a3-46b8-b6b5-f425ee4a8b5d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.505268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24755f-56a3-46b8-b6b5-f425ee4a8b5d None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.506956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24755f-56a3-46b8-b6b5-f425ee4a8b5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:44.507527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24755f-56a3-46b8-b6b5-f425ee4a8b5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.518413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24755f-56a3-46b8-b6b5-f425ee4a8b5d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.533135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 404/797] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:44.534100 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24755f-56a3-46b8-b6b5-f425ee4a8b5d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.578412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5e0ae-59e8-47bf-bfe6-2d41d68be8f7 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.617938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3f915-c1c4-46e6-b36e-d59dbde83c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.618730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3f915-c1c4-46e6-b36e-d59dbde83c46 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.618925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3f915-c1c4-46e6-b36e-d59dbde83c46 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.619205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3f915-c1c4-46e6-b36e-d59dbde83c46 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.620099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3f915-c1c4-46e6-b36e-d59dbde83c46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:44.620406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3f915-c1c4-46e6-b36e-d59dbde83c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.621822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3f915-c1c4-46e6-b36e-d59dbde83c46 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.636459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 394/798] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:44.636459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3f915-c1c4-46e6-b36e-d59dbde83c46 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.637597 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.649009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24755f-56a3-46b8-b6b5-f425ee4a8b5d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.686003 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d638-5c74-400e-923f-15e70d6d5e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.687446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.687631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d638-5c74-400e-923f-15e70d6d5e8b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.687892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d638-5c74-400e-923f-15e70d6d5e8b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.688180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d638-5c74-400e-923f-15e70d6d5e8b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.689189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d638-5c74-400e-923f-15e70d6d5e8b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.690666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d638-5c74-400e-923f-15e70d6d5e8b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-7e50d638-5c74-400e-923f-15e70d6d5e8b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:44.707401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:44.708449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 18:37:44.709273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:44.711043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 405/799] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:44.712488 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b957115-c579-48ab-bd4f-6d26a53484d9 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.712786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b957115-c579-48ab-bd4f-6d26a53484d9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.713069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b957115-c579-48ab-bd4f-6d26a53484d9 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.714682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 406/800] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:44.715545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b957115-c579-48ab-bd4f-6d26a53484d9 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.760189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3f915-c1c4-46e6-b36e-d59dbde83c46 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.806920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f5232-ca2c-443b-a2fa-def359d90c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.807827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5232-ca2c-443b-a2fa-def359d90c78 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.808116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5232-ca2c-443b-a2fa-def359d90c78 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.808400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f5232-ca2c-443b-a2fa-def359d90c78 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/f7da017f9a5b4bfcb5b97b5310e0a146/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.810457 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f5232-ca2c-443b-a2fa-def359d90c78 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=f7da017f9a5b4bfcb5b97b5310e0a146, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.812260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f5232-ca2c-443b-a2fa-def359d90c78 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.826227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 395/801] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:44 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/f7da017f9a5b4bfcb5b97b5310e0a146/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:44.827295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f5232-ca2c-443b-a2fa-def359d90c78 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:44.840455 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b957115-c579-48ab-bd4f-6d26a53484d9 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.892652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a207e8b-7d6a-427b-aada-364f2afac7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:44.894256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a207e8b-7d6a-427b-aada-364f2afac7c1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a207e8b-7d6a-427b-aada-364f2afac7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.895839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a207e8b-7d6a-427b-aada-364f2afac7c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.912025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a207e8b-7d6a-427b-aada-364f2afac7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:44.914258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a207e8b-7d6a-427b-aada-364f2afac7c1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-2a207e8b-7d6a-427b-aada-364f2afac7c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:44.941030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:44.942025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:44.942933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:44.942933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:44.942933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:44.942933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:44.949070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 407/802] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:44.949070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac173b5-1850-4def-99f1-dea0c39a2cb9 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:44.949070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac173b5-1850-4def-99f1-dea0c39a2cb9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:44.949070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac173b5-1850-4def-99f1-dea0c39a2cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:44.962841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f5232-ca2c-443b-a2fa-def359d90c78 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:44.964645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.966283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:44.974724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-bac173b5-1850-4def-99f1-dea0c39a2cb9 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:44.976445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bac173b5-1850-4def-99f1-dea0c39a2cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:45.007620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a835de-2ff9-4816-bbaa-ee932779f99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.008509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a835de-2ff9-4816-bbaa-ee932779f99d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.008795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a835de-2ff9-4816-bbaa-ee932779f99d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.009071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a835de-2ff9-4816-bbaa-ee932779f99d None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.009794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a835de-2ff9-4816-bbaa-ee932779f99d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.010103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a835de-2ff9-4816-bbaa-ee932779f99d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.011626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a835de-2ff9-4816-bbaa-ee932779f99d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.021186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 396/803] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.021186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a835de-2ff9-4816-bbaa-ee932779f99d None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.091058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 408/804] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:45.092365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac173b5-1850-4def-99f1-dea0c39a2cb9 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.143107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a835de-2ff9-4816-bbaa-ee932779f99d None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.182304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075055d-7e8e-42af-a67d-2c53fc06deda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.183006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075055d-7e8e-42af-a67d-2c53fc06deda None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.183295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075055d-7e8e-42af-a67d-2c53fc06deda None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.183708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075055d-7e8e-42af-a67d-2c53fc06deda None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.184409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075055d-7e8e-42af-a67d-2c53fc06deda None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.184726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075055d-7e8e-42af-a67d-2c53fc06deda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.186220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075055d-7e8e-42af-a67d-2c53fc06deda None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.200254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 397/805] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.201105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075055d-7e8e-42af-a67d-2c53fc06deda None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.201853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac173b5-1850-4def-99f1-dea0c39a2cb9 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.232980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.246334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30592c-81a7-4b5b-97c6-b6d88d54c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.247740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30592c-81a7-4b5b-97c6-b6d88d54c102 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.248244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30592c-81a7-4b5b-97c6-b6d88d54c102 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.248716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30592c-81a7-4b5b-97c6-b6d88d54c102 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.249666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30592c-81a7-4b5b-97c6-b6d88d54c102 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.250215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30592c-81a7-4b5b-97c6-b6d88d54c102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.251856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30592c-81a7-4b5b-97c6-b6d88d54c102 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.254505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.262701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 409/806] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.263920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30592c-81a7-4b5b-97c6-b6d88d54c102 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.318822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075055d-7e8e-42af-a67d-2c53fc06deda None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.358135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2b13-6a3a-450c-90ac-7e044d186827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.359658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2b13-6a3a-450c-90ac-7e044d186827 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.360198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2b13-6a3a-450c-90ac-7e044d186827 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.360640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2b13-6a3a-450c-90ac-7e044d186827 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.373015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2b13-6a3a-450c-90ac-7e044d186827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:45.373461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30592c-81a7-4b5b-97c6-b6d88d54c102 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-3b6c2b13-6a3a-450c-90ac-7e044d186827 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:45.381717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:45.382878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:45.383706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:45.386339 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 398/807] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:45.387405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2b13-6a3a-450c-90ac-7e044d186827 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.412351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095f470-6edb-4cf7-bbb4-f79aaa3a6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.413247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095f470-6edb-4cf7-bbb4-f79aaa3a6e34 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.413601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095f470-6edb-4cf7-bbb4-f79aaa3a6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.413961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095f470-6edb-4cf7-bbb4-f79aaa3a6e34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.421823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095f470-6edb-4cf7-bbb4-f79aaa3a6e34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.423379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095f470-6edb-4cf7-bbb4-f79aaa3a6e34 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-6095f470-6edb-4cf7-bbb4-f79aaa3a6e34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:45.440041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:45.441064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:37:45.442078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:45.445953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 410/808] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:45.446856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095f470-6edb-4cf7-bbb4-f79aaa3a6e34 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.495387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.508571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2b13-6a3a-450c-90ac-7e044d186827 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.509871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.548340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df754f-ef11-4483-8b86-282eccb13d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.549503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df754f-ef11-4483-8b86-282eccb13d83 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.550088 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df754f-ef11-4483-8b86-282eccb13d83 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.550604 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df754f-ef11-4483-8b86-282eccb13d83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.551626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df754f-ef11-4483-8b86-282eccb13d83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.552856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095f470-6edb-4cf7-bbb4-f79aaa3a6e34 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.553495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df754f-ef11-4483-8b86-282eccb13d83 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.579449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 399/809] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jun 16 18:37:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:45.580819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df754f-ef11-4483-8b86-282eccb13d83 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.619570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de2ee9-53ab-4b90-befd-5f04c0c0403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.620276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de2ee9-53ab-4b90-befd-5f04c0c0403f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.620548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de2ee9-53ab-4b90-befd-5f04c0c0403f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.620861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de2ee9-53ab-4b90-befd-5f04c0c0403f None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.622179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de2ee9-53ab-4b90-befd-5f04c0c0403f None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.622517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de2ee9-53ab-4b90-befd-5f04c0c0403f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.623916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de2ee9-53ab-4b90-befd-5f04c0c0403f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.643218 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 411/810] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.648326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de2ee9-53ab-4b90-befd-5f04c0c0403f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.714698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df754f-ef11-4483-8b86-282eccb13d83 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.756907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899de3f4-f0cf-4c38-ae68-b357a468bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.758163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899de3f4-f0cf-4c38-ae68-b357a468bc43 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.758691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899de3f4-f0cf-4c38-ae68-b357a468bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.759176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899de3f4-f0cf-4c38-ae68-b357a468bc43 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.760389 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899de3f4-f0cf-4c38-ae68-b357a468bc43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:45.760922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899de3f4-f0cf-4c38-ae68-b357a468bc43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.762795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899de3f4-f0cf-4c38-ae68-b357a468bc43 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.784400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 400/811] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:45.791334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899de3f4-f0cf-4c38-ae68-b357a468bc43 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.802889 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.831906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de2ee9-53ab-4b90-befd-5f04c0c0403f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.857243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:45.878995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10197928-76da-49cf-9b3f-8d01429c89e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.880438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10197928-76da-49cf-9b3f-8d01429c89e7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.880977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10197928-76da-49cf-9b3f-8d01429c89e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.881259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10197928-76da-49cf-9b3f-8d01429c89e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.896282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10197928-76da-49cf-9b3f-8d01429c89e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:45.898421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10197928-76da-49cf-9b3f-8d01429c89e7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:45.919587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899de3f4-f0cf-4c38-ae68-b357a468bc43 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-10197928-76da-49cf-9b3f-8d01429c89e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:45.921992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:45.922915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:45.923791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:45.923791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:45.923791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:45.923791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:45.923791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 412/812] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:45.925975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2e88a-9de7-47c4-9255-129d6a9eac7c None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.926263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2e88a-9de7-47c4-9255-129d6a9eac7c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.926602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2e88a-9de7-47c4-9255-129d6a9eac7c None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:45.928308 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 413/813] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:45.929100 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2e88a-9de7-47c4-9255-129d6a9eac7c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:45.973649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e399-22fe-413c-9f07-2042f1b19cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:45.974789 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e399-22fe-413c-9f07-2042f1b19cde None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:45.975288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e399-22fe-413c-9f07-2042f1b19cde None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:45.976797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e399-22fe-413c-9f07-2042f1b19cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.057963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760e399-22fe-413c-9f07-2042f1b19cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.059255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760e399-22fe-413c-9f07-2042f1b19cde None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.061339 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.076831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2e88a-9de7-47c4-9255-129d6a9eac7c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.120465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8196567-1169-447e-b564-2449fb8cd211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.121516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8196567-1169-447e-b564-2449fb8cd211 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.122010 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8196567-1169-447e-b564-2449fb8cd211 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.122512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8196567-1169-447e-b564-2449fb8cd211 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.123544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8196567-1169-447e-b564-2449fb8cd211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:46.124108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8196567-1169-447e-b564-2449fb8cd211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.125693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8196567-1169-447e-b564-2449fb8cd211 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.139698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 414/814] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:46.141376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfea25-6a76-4c3a-990e-ce2a50ea9830 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.141878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfea25-6a76-4c3a-990e-ce2a50ea9830 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.142348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfea25-6a76-4c3a-990e-ce2a50ea9830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.165072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-a2dfea25-6a76-4c3a-990e-ce2a50ea9830 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:46.166508 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a2dfea25-6a76-4c3a-990e-ce2a50ea9830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:46.177028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 401/815] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:37:46.177986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e399-22fe-413c-9f07-2042f1b19cde None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.193852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.244720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 415/816] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:46.245909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfea25-6a76-4c3a-990e-ce2a50ea9830 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.285637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e399-22fe-413c-9f07-2042f1b19cde None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.287218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.325753 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114490d-1535-4a8b-857c-c9c32e70fb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.326512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114490d-1535-4a8b-857c-c9c32e70fb88 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.326871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114490d-1535-4a8b-857c-c9c32e70fb88 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.327061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114490d-1535-4a8b-857c-c9c32e70fb88 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.335591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114490d-1535-4a8b-857c-c9c32e70fb88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.337056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114490d-1535-4a8b-857c-c9c32e70fb88 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-b114490d-1535-4a8b-857c-c9c32e70fb88 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:46.357730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:46.359398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 402/817] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:46.360538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114490d-1535-4a8b-857c-c9c32e70fb88 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.365842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfea25-6a76-4c3a-990e-ce2a50ea9830 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.409385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc82b-0ffc-49de-a7dd-78dd959c0296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.410538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc82b-0ffc-49de-a7dd-78dd959c0296 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.410988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc82b-0ffc-49de-a7dd-78dd959c0296 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.411409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc82b-0ffc-49de-a7dd-78dd959c0296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.425090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccc82b-0ffc-49de-a7dd-78dd959c0296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.427122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccc82b-0ffc-49de-a7dd-78dd959c0296 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-c3ccc82b-0ffc-49de-a7dd-78dd959c0296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:46.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:46.452374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:46.453453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:46.453453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:46.453453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:46.453453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:46.455842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 416/818] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:46.456834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc82b-0ffc-49de-a7dd-78dd959c0296 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.475497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.495782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114490d-1535-4a8b-857c-c9c32e70fb88 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.539443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c9d29-208f-406f-b6f0-fa78e7a98e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.540652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c9d29-208f-406f-b6f0-fa78e7a98e64 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.541082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c9d29-208f-406f-b6f0-fa78e7a98e64 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.541533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c9d29-208f-406f-b6f0-fa78e7a98e64 None admin] PATH_INFO: `/v3/services/network` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.542957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c9d29-208f-406f-b6f0-fa78e7a98e64 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.545666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c9d29-208f-406f-b6f0-fa78e7a98e64 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-818c9d29-208f-406f-b6f0-fa78e7a98e64 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:46.567757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:46.568807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 18:37:46.569634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:46.572097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 403/819] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:46.573019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c9d29-208f-406f-b6f0-fa78e7a98e64 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.607503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.621762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc82b-0ffc-49de-a7dd-78dd959c0296 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.669697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22d98b-3b36-46c9-89ad-098e0f0eb331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.671146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22d98b-3b36-46c9-89ad-098e0f0eb331 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.671641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22d98b-3b36-46c9-89ad-098e0f0eb331 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.672363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22d98b-3b36-46c9-89ad-098e0f0eb331 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.673620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22d98b-3b36-46c9-89ad-098e0f0eb331 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:46.674137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22d98b-3b36-46c9-89ad-098e0f0eb331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.676586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22d98b-3b36-46c9-89ad-098e0f0eb331 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.692647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c9d29-208f-406f-b6f0-fa78e7a98e64 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.701030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 417/820] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:46.702231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22d98b-3b36-46c9-89ad-098e0f0eb331 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.729119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be60235-3629-4009-9d3f-86eab47023e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.729910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be60235-3629-4009-9d3f-86eab47023e7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.730690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be60235-3629-4009-9d3f-86eab47023e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.730690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be60235-3629-4009-9d3f-86eab47023e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.731448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be60235-3629-4009-9d3f-86eab47023e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:46.731827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be60235-3629-4009-9d3f-86eab47023e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.733410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be60235-3629-4009-9d3f-86eab47023e7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.752475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 404/821] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:46.753341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be60235-3629-4009-9d3f-86eab47023e7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.789684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.834537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22d98b-3b36-46c9-89ad-098e0f0eb331 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.860769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:46.878422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bab1c0-6857-4625-a955-595165db24ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.879321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bab1c0-6857-4625-a955-595165db24ab None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.879677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bab1c0-6857-4625-a955-595165db24ab None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.880025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bab1c0-6857-4625-a955-595165db24ab None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.881135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bab1c0-6857-4625-a955-595165db24ab None admin] RBAC: Adding query filter params (name=network) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:46.881776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bab1c0-6857-4625-a955-595165db24ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.883247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bab1c0-6857-4625-a955-595165db24ab None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:46.885827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be60235-3629-4009-9d3f-86eab47023e7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:46.888278 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 418/822] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:46.889311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bab1c0-6857-4625-a955-595165db24ab None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:46.955888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690b15d-b6cb-417d-901e-d4eaf31242bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:46.958364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690b15d-b6cb-417d-901e-d4eaf31242bb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:46.959282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690b15d-b6cb-417d-901e-d4eaf31242bb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:46.959787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690b15d-b6cb-417d-901e-d4eaf31242bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:46.986520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690b15d-b6cb-417d-901e-d4eaf31242bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:46.990652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690b15d-b6cb-417d-901e-d4eaf31242bb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.012386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bab1c0-6857-4625-a955-595165db24ab None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-b690b15d-b6cb-417d-901e-d4eaf31242bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:47.031224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:47.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:47.034662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:47.034662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:47.034662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:47.034662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:47.034662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 405/823] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:47.034662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690b15d-b6cb-417d-901e-d4eaf31242bb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.063868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7505da-1e71-46f5-8875-fb14dba4733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.064958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7505da-1e71-46f5-8875-fb14dba4733a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.065244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7505da-1e71-46f5-8875-fb14dba4733a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.065520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7505da-1e71-46f5-8875-fb14dba4733a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.069204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:47.079330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7505da-1e71-46f5-8875-fb14dba4733a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.080807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7505da-1e71-46f5-8875-fb14dba4733a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-8f7505da-1e71-46f5-8875-fb14dba4733a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:47.101203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:47.103257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:47.104137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:47.104137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:47.104137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:47.104137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:47.104137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:47.104137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:47.104137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:47.104137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:47.106475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 419/824] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:47.107914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7505da-1e71-46f5-8875-fb14dba4733a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.178462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690b15d-b6cb-417d-901e-d4eaf31242bb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.221636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2caca7-9f10-4fb7-9816-d60be3b27a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.222264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2caca7-9f10-4fb7-9816-d60be3b27a72 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.222576 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2caca7-9f10-4fb7-9816-d60be3b27a72 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.223033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2caca7-9f10-4fb7-9816-d60be3b27a72 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.223600 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2caca7-9f10-4fb7-9816-d60be3b27a72 None admin] RBAC: Adding query filter params (type=network) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:47.223893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2caca7-9f10-4fb7-9816-d60be3b27a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.225258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2caca7-9f10-4fb7-9816-d60be3b27a72 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.225953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7505da-1e71-46f5-8875-fb14dba4733a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.235524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 406/825] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:47.235524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2caca7-9f10-4fb7-9816-d60be3b27a72 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.238491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:47.262994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85a209-9d63-4611-a855-19b0072ee88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.263655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85a209-9d63-4611-a855-19b0072ee88d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.263934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85a209-9d63-4611-a855-19b0072ee88d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.264296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85a209-9d63-4611-a855-19b0072ee88d None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.264912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85a209-9d63-4611-a855-19b0072ee88d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:47.265213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85a209-9d63-4611-a855-19b0072ee88d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.266589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85a209-9d63-4611-a855-19b0072ee88d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.279444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 420/826] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:47.280742 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cf832-9ac0-44f9-bcd7-40f4ba268182 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.281110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cf832-9ac0-44f9-bcd7-40f4ba268182 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.281386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cf832-9ac0-44f9-bcd7-40f4ba268182 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.282804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 421/827] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:47.287584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cf832-9ac0-44f9-bcd7-40f4ba268182 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.352081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:47.358493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2caca7-9f10-4fb7-9816-d60be3b27a72 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.397638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c7d7e-332f-44f0-aec9-7ccb4924490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.398478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7d7e-332f-44f0-aec9-7ccb4924490e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.398762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7d7e-332f-44f0-aec9-7ccb4924490e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.399063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7d7e-332f-44f0-aec9-7ccb4924490e None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.399934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c7d7e-332f-44f0-aec9-7ccb4924490e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:47.400245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c7d7e-332f-44f0-aec9-7ccb4924490e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.401822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c7d7e-332f-44f0-aec9-7ccb4924490e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.405990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cf832-9ac0-44f9-bcd7-40f4ba268182 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.419737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 407/828] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:47.419737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c7d7e-332f-44f0-aec9-7ccb4924490e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.449407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ae4d-478a-4027-9533-663f0af80f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.449995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ae4d-478a-4027-9533-663f0af80f59 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.450280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ae4d-478a-4027-9533-663f0af80f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.450614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ae4d-478a-4027-9533-663f0af80f59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.451386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37ae4d-478a-4027-9533-663f0af80f59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.452754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37ae4d-478a-4027-9533-663f0af80f59 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.473143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 422/829] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jun 16 18:37:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:47.474455 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df21e1-adb1-4ec4-be5a-b4996181fe4e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.474752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df21e1-adb1-4ec4-be5a-b4996181fe4e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.475033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df21e1-adb1-4ec4-be5a-b4996181fe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.501122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:47.508572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-67df21e1-adb1-4ec4-be5a-b4996181fe4e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:47.510005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-67df21e1-adb1-4ec4-be5a-b4996181fe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:47.558596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c7d7e-332f-44f0-aec9-7ccb4924490e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.604002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 423/830] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:47.604894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df21e1-adb1-4ec4-be5a-b4996181fe4e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.611739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945adb5-db44-4a09-bcd6-a83645477bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.612823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945adb5-db44-4a09-bcd6-a83645477bb7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.613844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945adb5-db44-4a09-bcd6-a83645477bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.614315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945adb5-db44-4a09-bcd6-a83645477bb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.624278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945adb5-db44-4a09-bcd6-a83645477bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.625827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945adb5-db44-4a09-bcd6-a83645477bb7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-a945adb5-db44-4a09-bcd6-a83645477bb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:47.650962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:47.652142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 408/831] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:47.654017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945adb5-db44-4a09-bcd6-a83645477bb7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.657222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:47.745212 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df21e1-adb1-4ec4-be5a-b4996181fe4e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.791474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945adb5-db44-4a09-bcd6-a83645477bb7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.804215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda524-b330-4128-8a74-ea5c6774cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.804215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda524-b330-4128-8a74-ea5c6774cd2b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.804215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda524-b330-4128-8a74-ea5c6774cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.804215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda524-b330-4128-8a74-ea5c6774cd2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.804670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acda524-b330-4128-8a74-ea5c6774cd2b None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6cba70fa423e413a9222021116ff5718) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:47.804670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acda524-b330-4128-8a74-ea5c6774cd2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.804670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acda524-b330-4128-8a74-ea5c6774cd2b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:47.810304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 424/832] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/role_assignments?user.id=6cba70fa423e413a9222021116ff5718&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:47.811019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda524-b330-4128-8a74-ea5c6774cd2b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.833896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:47.851957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb096-8987-4672-83da-0ee532a03363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.853311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb096-8987-4672-83da-0ee532a03363 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.853868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb096-8987-4672-83da-0ee532a03363 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.854148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb096-8987-4672-83da-0ee532a03363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.870892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eb096-8987-4672-83da-0ee532a03363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-c22eb096-8987-4672-83da-0ee532a03363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:47.881966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:47.882998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:37:47.883815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:47.884428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 409/833] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:47.890819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb096-8987-4672-83da-0ee532a03363 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:47.936736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:47.940356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda524-b330-4128-8a74-ea5c6774cd2b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:47.983090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7234ae-6e47-4d1a-860c-503347bee3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:47.983786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7234ae-6e47-4d1a-860c-503347bee3fb None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:47.984072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7234ae-6e47-4d1a-860c-503347bee3fb None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:47.984352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7234ae-6e47-4d1a-860c-503347bee3fb None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:47.985311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7234ae-6e47-4d1a-860c-503347bee3fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:47.985635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7234ae-6e47-4d1a-860c-503347bee3fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:47.987187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7234ae-6e47-4d1a-860c-503347bee3fb None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.004842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 425/834] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:48.011523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7234ae-6e47-4d1a-860c-503347bee3fb None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.029167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb096-8987-4672-83da-0ee532a03363 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.073926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a25b2-4550-4a50-868e-763807f676f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.074640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a25b2-4550-4a50-868e-763807f676f7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.074933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a25b2-4550-4a50-868e-763807f676f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.075211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a25b2-4550-4a50-868e-763807f676f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.076382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a25b2-4550-4a50-868e-763807f676f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:48.076382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a25b2-4550-4a50-868e-763807f676f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.077660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a25b2-4550-4a50-868e-763807f676f7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.087993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 410/835] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:37:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:48.089929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1b05-61a6-4a5c-8c47-92abb11201f9 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.090222 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1b05-61a6-4a5c-8c47-92abb11201f9 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.090534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1b05-61a6-4a5c-8c47-92abb11201f9 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.092012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 411/836] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:48.096259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1b05-61a6-4a5c-8c47-92abb11201f9 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.127285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7234ae-6e47-4d1a-860c-503347bee3fb None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.147162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.178890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377954-4f96-4055-bd6c-1ec7a8d72e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.179793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377954-4f96-4055-bd6c-1ec7a8d72e24 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.180081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377954-4f96-4055-bd6c-1ec7a8d72e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.180361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377954-4f96-4055-bd6c-1ec7a8d72e24 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6e8f3976dd524feeb4277e4ba4c8090b/roles/9e9a366e60114fa1ae7e33a6a7af2934` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.201328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f377954-4f96-4055-bd6c-1ec7a8d72e24 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=6e8f3976dd524feeb4277e4ba4c8090b, role_id=9e9a366e60114fa1ae7e33a6a7af2934)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.204321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f377954-4f96-4055-bd6c-1ec7a8d72e24 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.216632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1b05-61a6-4a5c-8c47-92abb11201f9 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.227310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 426/837] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:37:48 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6e8f3976dd524feeb4277e4ba4c8090b/roles/9e9a366e60114fa1ae7e33a6a7af2934 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:37:48.230439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77fee1-4c6b-40cb-951e-cedddf8def35 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.230987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77fee1-4c6b-40cb-951e-cedddf8def35 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.231778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77fee1-4c6b-40cb-951e-cedddf8def35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.261360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-6f77fee1-4c6b-40cb-951e-cedddf8def35 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:48.261906 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c33f-5600-416d-bd71-0f5250586b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.262787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c33f-5600-416d-bd71-0f5250586b4b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.263074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c33f-5600-416d-bd71-0f5250586b4b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.263354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c33f-5600-416d-bd71-0f5250586b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.263707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6f77fee1-4c6b-40cb-951e-cedddf8def35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:48.267629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.280594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683c33f-5600-416d-bd71-0f5250586b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.282278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683c33f-5600-416d-bd71-0f5250586b4b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-a683c33f-5600-416d-bd71-0f5250586b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:48.302988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:48.303931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:48.304824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:48.304824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:48.304824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:48.304824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:48.304824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 412/838] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:48.314352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c33f-5600-416d-bd71-0f5250586b4b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.366944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 427/839] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:48.381781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77fee1-4c6b-40cb-951e-cedddf8def35 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.455464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.463855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c33f-5600-416d-bd71-0f5250586b4b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.523936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e9758-6e4a-4501-a1fe-c3d78d235da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.525391 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e9758-6e4a-4501-a1fe-c3d78d235da0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.526370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e9758-6e4a-4501-a1fe-c3d78d235da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.526959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e9758-6e4a-4501-a1fe-c3d78d235da0 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.527942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e9758-6e4a-4501-a1fe-c3d78d235da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:48.528711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e9758-6e4a-4501-a1fe-c3d78d235da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.531335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e9758-6e4a-4501-a1fe-c3d78d235da0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.532319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77fee1-4c6b-40cb-951e-cedddf8def35 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.550260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 413/840] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:48.559833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e9758-6e4a-4501-a1fe-c3d78d235da0 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.581241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ad17-e162-43c7-b9f0-3688903cd825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.582055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ad17-e162-43c7-b9f0-3688903cd825 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.582332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ad17-e162-43c7-b9f0-3688903cd825 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.582637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ad17-e162-43c7-b9f0-3688903cd825 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.583294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79ad17-e162-43c7-b9f0-3688903cd825 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.585490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79ad17-e162-43c7-b9f0-3688903cd825 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-9d79ad17-e162-43c7-b9f0-3688903cd825 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:48.605550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:48.606664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:37:48.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:48.610694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 428/841] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:48.617339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ad17-e162-43c7-b9f0-3688903cd825 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.624113 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.697626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e9758-6e4a-4501-a1fe-c3d78d235da0 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.736663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882827c7-17eb-4adc-99b9-012af7ad9089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.737518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882827c7-17eb-4adc-99b9-012af7ad9089 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.737832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882827c7-17eb-4adc-99b9-012af7ad9089 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.738336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882827c7-17eb-4adc-99b9-012af7ad9089 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.746446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882827c7-17eb-4adc-99b9-012af7ad9089 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.748115 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882827c7-17eb-4adc-99b9-012af7ad9089 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.757552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ad17-e162-43c7-b9f0-3688903cd825 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-882827c7-17eb-4adc-99b9-012af7ad9089 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:48.765078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:48.766054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 18:37:48.767008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:48.770712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 414/842] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:48.773350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882827c7-17eb-4adc-99b9-012af7ad9089 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.794080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.807715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67242bea-1e3a-47d4-82b0-848b4204cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.808703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67242bea-1e3a-47d4-82b0-848b4204cffc None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.808995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67242bea-1e3a-47d4-82b0-848b4204cffc None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.809275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67242bea-1e3a-47d4-82b0-848b4204cffc None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.810255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67242bea-1e3a-47d4-82b0-848b4204cffc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:48.810667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67242bea-1e3a-47d4-82b0-848b4204cffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.813011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67242bea-1e3a-47d4-82b0-848b4204cffc None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.822532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 429/843] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:48.825856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67242bea-1e3a-47d4-82b0-848b4204cffc None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:48.889902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882827c7-17eb-4adc-99b9-012af7ad9089 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.918816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:48.929878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d710c-6d0c-49de-aefd-8b11f92b30ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:48.930607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d710c-6d0c-49de-aefd-8b11f92b30ec None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:48.930896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d710c-6d0c-49de-aefd-8b11f92b30ec None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:48.931179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d710c-6d0c-49de-aefd-8b11f92b30ec None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:48.932034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d710c-6d0c-49de-aefd-8b11f92b30ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:48.932348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d710c-6d0c-49de-aefd-8b11f92b30ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:48.934419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d710c-6d0c-49de-aefd-8b11f92b30ec None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:48.960185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67242bea-1e3a-47d4-82b0-848b4204cffc None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:48.962532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 415/844] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:48.967001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d710c-6d0c-49de-aefd-8b11f92b30ec None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.000969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283b9a6-9c12-49e1-bb56-05fd204cd781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.001909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283b9a6-9c12-49e1-bb56-05fd204cd781 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.002041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283b9a6-9c12-49e1-bb56-05fd204cd781 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.002221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283b9a6-9c12-49e1-bb56-05fd204cd781 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.002971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283b9a6-9c12-49e1-bb56-05fd204cd781 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:49.003276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283b9a6-9c12-49e1-bb56-05fd204cd781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.005217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283b9a6-9c12-49e1-bb56-05fd204cd781 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.018818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 430/845] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:49.072093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.110834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d710c-6d0c-49de-aefd-8b11f92b30ec None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.155791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4a240-6d28-49af-8e33-5d0ebd3bbc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.156498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4a240-6d28-49af-8e33-5d0ebd3bbc4c None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.156790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4a240-6d28-49af-8e33-5d0ebd3bbc4c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.157074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4a240-6d28-49af-8e33-5d0ebd3bbc4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.235535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4a240-6d28-49af-8e33-5d0ebd3bbc4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.237016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4a240-6d28-49af-8e33-5d0ebd3bbc4c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.439764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.466977 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 416/846] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:37:49.473560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283b9a6-9c12-49e1-bb56-05fd204cd781 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.596338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283b9a6-9c12-49e1-bb56-05fd204cd781 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.629138 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.636568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c139d-6e01-4f32-8448-2cdd174a094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.637709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c139d-6e01-4f32-8448-2cdd174a094e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.638197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c139d-6e01-4f32-8448-2cdd174a094e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.638721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c139d-6e01-4f32-8448-2cdd174a094e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.651303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c139d-6e01-4f32-8448-2cdd174a094e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.653191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c139d-6e01-4f32-8448-2cdd174a094e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-485c139d-6e01-4f32-8448-2cdd174a094e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:49.672544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:49.673498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:49.674434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:49.674434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:49.674434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:49.674434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:49.676848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 431/847] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:49.682648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4a240-6d28-49af-8e33-5d0ebd3bbc4c None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.788262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4a240-6d28-49af-8e33-5d0ebd3bbc4c None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.825159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca94c-48cb-453a-8a4d-bca99c58a064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.826199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca94c-48cb-453a-8a4d-bca99c58a064 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.826734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca94c-48cb-453a-8a4d-bca99c58a064 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.827206 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca94c-48cb-453a-8a4d-bca99c58a064 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:49.828127 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ca94c-48cb-453a-8a4d-bca99c58a064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:49.828641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ca94c-48cb-453a-8a4d-bca99c58a064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:49.830213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ca94c-48cb-453a-8a4d-bca99c58a064 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:49.843507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 417/848] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:49.849898 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c139d-6e01-4f32-8448-2cdd174a094e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:49.959455 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c139d-6e01-4f32-8448-2cdd174a094e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:49.996019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7f26d-65f4-42e1-9c33-8fa36bb0e813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:49.996814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7f26d-65f4-42e1-9c33-8fa36bb0e813 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:49.997094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7f26d-65f4-42e1-9c33-8fa36bb0e813 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:49.997366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7f26d-65f4-42e1-9c33-8fa36bb0e813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.005144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7f26d-65f4-42e1-9c33-8fa36bb0e813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.006590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7f26d-65f4-42e1-9c33-8fa36bb0e813 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-10b7f26d-65f4-42e1-9c33-8fa36bb0e813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:50.021468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:50.022405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:50.023326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:50.023326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:50.023326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:50.023326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:50.023326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:50.023326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:50.023326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:50.023326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:50.023326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 432/849] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:50.028585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca94c-48cb-453a-8a4d-bca99c58a064 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.064331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.145265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca94c-48cb-453a-8a4d-bca99c58a064 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.169404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7329b9-b007-46a8-8a93-22bfbacd78d2 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.169686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7329b9-b007-46a8-8a93-22bfbacd78d2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.169966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7329b9-b007-46a8-8a93-22bfbacd78d2 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.171713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 433/850] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:50.177606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bd01-8f61-446d-8f94-82cf50e6aebf None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.177876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bd01-8f61-446d-8f94-82cf50e6aebf None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.178151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bd01-8f61-446d-8f94-82cf50e6aebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.185847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2cdf0-9f80-4dab-b0dc-368d5c89a3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.186920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2cdf0-9f80-4dab-b0dc-368d5c89a3d2 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.187645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2cdf0-9f80-4dab-b0dc-368d5c89a3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.188143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2cdf0-9f80-4dab-b0dc-368d5c89a3d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.189107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2cdf0-9f80-4dab-b0dc-368d5c89a3d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:50.189622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2cdf0-9f80-4dab-b0dc-368d5c89a3d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.191329 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2cdf0-9f80-4dab-b0dc-368d5c89a3d2 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.196738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-92d8bd01-8f61-446d-8f94-82cf50e6aebf None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:50.197924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-92d8bd01-8f61-446d-8f94-82cf50e6aebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:50.206028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 418/851] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:50.214433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2cdf0-9f80-4dab-b0dc-368d5c89a3d2 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.245819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.282404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 434/852] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:37:50.298950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8bd01-8f61-446d-8f94-82cf50e6aebf None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.337593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.346418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2cdf0-9f80-4dab-b0dc-368d5c89a3d2 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.383669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8814-6e29-4dc5-aaf0-a3cc9ab11d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.384337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8814-6e29-4dc5-aaf0-a3cc9ab11d17 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.384629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8814-6e29-4dc5-aaf0-a3cc9ab11d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.384903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8814-6e29-4dc5-aaf0-a3cc9ab11d17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.386211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee8814-6e29-4dc5-aaf0-a3cc9ab11d17 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=f7da017f9a5b4bfcb5b97b5310e0a146) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:50.386211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee8814-6e29-4dc5-aaf0-a3cc9ab11d17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.387608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee8814-6e29-4dc5-aaf0-a3cc9ab11d17 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.398520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 419/853] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/role_assignments?user.id=f7da017f9a5b4bfcb5b97b5310e0a146&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:50.421517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8bd01-8f61-446d-8f94-82cf50e6aebf None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.463252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab001a63-d8df-489a-99a6-391c140d3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.464551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001a63-d8df-489a-99a6-391c140d3260 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.465046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001a63-d8df-489a-99a6-391c140d3260 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.465523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001a63-d8df-489a-99a6-391c140d3260 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.466465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001a63-d8df-489a-99a6-391c140d3260 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.468250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001a63-d8df-489a-99a6-391c140d3260 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-ab001a63-d8df-489a-99a6-391c140d3260 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:50.482227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:50.483275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:37:50.484134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:50.487365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 435/854] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:50.495608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8814-6e29-4dc5-aaf0-a3cc9ab11d17 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.541562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9601-3b70-45ab-95b8-05fbf6370657 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.541879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9601-3b70-45ab-95b8-05fbf6370657 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.542125 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9601-3b70-45ab-95b8-05fbf6370657 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.543814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 436/855] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:50.552011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83dc7f-b242-4453-92b8-0d8321dbc7c2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.552522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83dc7f-b242-4453-92b8-0d8321dbc7c2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.552923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83dc7f-b242-4453-92b8-0d8321dbc7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.572603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-af83dc7f-b242-4453-92b8-0d8321dbc7c2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:50.574177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-af83dc7f-b242-4453-92b8-0d8321dbc7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:50.608254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.622596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8814-6e29-4dc5-aaf0-a3cc9ab11d17 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.662184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 437/856] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:37:50.674942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f6b73-4c12-4d81-8f2f-60c5e55b48c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.675788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f6b73-4c12-4d81-8f2f-60c5e55b48c4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.676629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f6b73-4c12-4d81-8f2f-60c5e55b48c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.676919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f6b73-4c12-4d81-8f2f-60c5e55b48c4 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.677621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f6b73-4c12-4d81-8f2f-60c5e55b48c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:50.677928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f6b73-4c12-4d81-8f2f-60c5e55b48c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.683630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f6b73-4c12-4d81-8f2f-60c5e55b48c4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.693085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83dc7f-b242-4453-92b8-0d8321dbc7c2 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.693400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 420/857] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:50.700296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f6b73-4c12-4d81-8f2f-60c5e55b48c4 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:50.737144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.810217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83dc7f-b242-4453-92b8-0d8321dbc7c2 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.837766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f6b73-4c12-4d81-8f2f-60c5e55b48c4 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:50.860862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b9e01-4cf3-42a8-9a0c-9eec38a80e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.862214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b9e01-4cf3-42a8-9a0c-9eec38a80e12 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.862658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b9e01-4cf3-42a8-9a0c-9eec38a80e12 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.863069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b9e01-4cf3-42a8-9a0c-9eec38a80e12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.878905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b9e01-4cf3-42a8-9a0c-9eec38a80e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:50.879895 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c9ca1-fa0a-4775-8b47-abbae988140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:50.880706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c9ca1-fa0a-4775-8b47-abbae988140d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:50.881121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c9ca1-fa0a-4775-8b47-abbae988140d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:50.881495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c9ca1-fa0a-4775-8b47-abbae988140d None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:50.882302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c9ca1-fa0a-4775-8b47-abbae988140d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:50.882729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c9ca1-fa0a-4775-8b47-abbae988140d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:50.884182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c9ca1-fa0a-4775-8b47-abbae988140d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-499b9e01-4cf3-42a8-9a0c-9eec38a80e12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:50.889072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:50.890012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:37:50.890862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:50.897716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 421/859] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:50.897966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 438/859] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:50.899180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c9ca1-fa0a-4775-8b47-abbae988140d None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.005830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.025847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c9ca1-fa0a-4775-8b47-abbae988140d None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.065211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570e356-adae-4043-8b55-247efa4df460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.065892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e356-adae-4043-8b55-247efa4df460 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.066179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e356-adae-4043-8b55-247efa4df460 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.066484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e356-adae-4043-8b55-247efa4df460 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.067279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570e356-adae-4043-8b55-247efa4df460 None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:51.067587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570e356-adae-4043-8b55-247efa4df460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.068963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570e356-adae-4043-8b55-247efa4df460 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.078645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 422/860] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:51.086298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b9e01-4cf3-42a8-9a0c-9eec38a80e12 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.119761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.201894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b9e01-4cf3-42a8-9a0c-9eec38a80e12 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.240454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757051b-1e0d-4847-b52e-8fd7bbb83ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.241271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757051b-1e0d-4847-b52e-8fd7bbb83ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.241558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757051b-1e0d-4847-b52e-8fd7bbb83ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.241837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757051b-1e0d-4847-b52e-8fd7bbb83ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.255009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757051b-1e0d-4847-b52e-8fd7bbb83ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.256886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757051b-1e0d-4847-b52e-8fd7bbb83ea9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-8757051b-1e0d-4847-b52e-8fd7bbb83ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:51.276350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:51.277273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:51.278137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:51.278137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:51.278137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:51.278137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:51.280420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 439/861] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:51.286202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570e356-adae-4043-8b55-247efa4df460 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.300210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ff23-1500-474d-9fbe-8e2d3189a1b4 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.300511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ff23-1500-474d-9fbe-8e2d3189a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.300773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ff23-1500-474d-9fbe-8e2d3189a1b4 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.303000 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 440/862] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:51.308033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf1ba5-9805-4d16-8695-1c87919664f7 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.308511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf1ba5-9805-4d16-8695-1c87919664f7 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.308796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf1ba5-9805-4d16-8695-1c87919664f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.328123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-50cf1ba5-9805-4d16-8695-1c87919664f7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:51.329630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-50cf1ba5-9805-4d16-8695-1c87919664f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:51.393955 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570e356-adae-4043-8b55-247efa4df460 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.403486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 441/863] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:37:51.425652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf1ba5-9805-4d16-8695-1c87919664f7 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.434371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb57b-a98e-4564-8710-c1001a01e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.435497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb57b-a98e-4564-8710-c1001a01e492 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.435983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb57b-a98e-4564-8710-c1001a01e492 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.436548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb57b-a98e-4564-8710-c1001a01e492 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.437847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731eb57b-a98e-4564-8710-c1001a01e492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:51.438354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731eb57b-a98e-4564-8710-c1001a01e492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.438864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.440885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731eb57b-a98e-4564-8710-c1001a01e492 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.458043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 423/864] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:51.463589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb57b-a98e-4564-8710-c1001a01e492 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.476469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.569282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf1ba5-9805-4d16-8695-1c87919664f7 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.591664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb57b-a98e-4564-8710-c1001a01e492 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.611353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6dfa3-e521-459b-9f8c-dcae0f686b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.612766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6dfa3-e521-459b-9f8c-dcae0f686b8d None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.613256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6dfa3-e521-459b-9f8c-dcae0f686b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.613884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6dfa3-e521-459b-9f8c-dcae0f686b8d None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.614944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6dfa3-e521-459b-9f8c-dcae0f686b8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.616599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6dfa3-e521-459b-9f8c-dcae0f686b8d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.630628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f40e1-5d5b-4c68-844a-72b133fe7057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.631541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f40e1-5d5b-4c68-844a-72b133fe7057 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.631831 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f40e1-5d5b-4c68-844a-72b133fe7057 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.632112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f40e1-5d5b-4c68-844a-72b133fe7057 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.640856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f40e1-5d5b-4c68-844a-72b133fe7057 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.641670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 442/865] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:37:51 2022] POST /identity/v3/services => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:37:51.642602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f40e1-5d5b-4c68-844a-72b133fe7057 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-5e5f40e1-5d5b-4c68-844a-72b133fe7057 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:51.669086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:51.670174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:51.671155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 424/866] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:51.676635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6dfa3-e521-459b-9f8c-dcae0f686b8d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.763325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.805508 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6dfa3-e521-459b-9f8c-dcae0f686b8d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:51.842724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647935c-5a2e-478c-afeb-5f8b9db40611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:51.843402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647935c-5a2e-478c-afeb-5f8b9db40611 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:51.843694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647935c-5a2e-478c-afeb-5f8b9db40611 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:51.843967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647935c-5a2e-478c-afeb-5f8b9db40611 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:51.844811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647935c-5a2e-478c-afeb-5f8b9db40611 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:51.845123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647935c-5a2e-478c-afeb-5f8b9db40611 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:51.846576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647935c-5a2e-478c-afeb-5f8b9db40611 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:51.865377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 443/867] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:51.871282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f40e1-5d5b-4c68-844a-72b133fe7057 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:51.944552 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:51.981997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f40e1-5d5b-4c68-844a-72b133fe7057 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.018554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee46c9-50fa-4ca0-bd97-523ce92b2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.019575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee46c9-50fa-4ca0-bd97-523ce92b2ccf None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.020581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee46c9-50fa-4ca0-bd97-523ce92b2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.021070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee46c9-50fa-4ca0-bd97-523ce92b2ccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.123661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee46c9-50fa-4ca0-bd97-523ce92b2ccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.125483 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee46c9-50fa-4ca0-bd97-523ce92b2ccf None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.195726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:52.235618 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 425/868] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:51 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 18:37:52.241513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647935c-5a2e-478c-afeb-5f8b9db40611 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.348888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647935c-5a2e-478c-afeb-5f8b9db40611 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.374313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:52.386765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e501-4714-467d-9fd1-a8f4b43a589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.387900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e501-4714-467d-9fd1-a8f4b43a589c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.388379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e501-4714-467d-9fd1-a8f4b43a589c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.388848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e501-4714-467d-9fd1-a8f4b43a589c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.400291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028e501-4714-467d-9fd1-a8f4b43a589c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.402017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028e501-4714-467d-9fd1-a8f4b43a589c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-6028e501-4714-467d-9fd1-a8f4b43a589c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:52.420163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:52.421055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:52.421948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:52.421948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:52.421948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:52.421948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:52.424139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 444/869] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:52.429879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee46c9-50fa-4ca0-bd97-523ce92b2ccf None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.534949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee46c9-50fa-4ca0-bd97-523ce92b2ccf None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.570970 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21aeac5-7485-452f-874a-b4602fc8c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.572080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aeac5-7485-452f-874a-b4602fc8c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.572558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aeac5-7485-452f-874a-b4602fc8c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.573044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21aeac5-7485-452f-874a-b4602fc8c9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.573971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aeac5-7485-452f-874a-b4602fc8c9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:52.574519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aeac5-7485-452f-874a-b4602fc8c9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.576076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21aeac5-7485-452f-874a-b4602fc8c9b7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.588887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 426/870] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:52.594596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e501-4714-467d-9fd1-a8f4b43a589c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.689130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd07d52-ac76-4785-be75-1b3a5ebb399a None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.689639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd07d52-ac76-4785-be75-1b3a5ebb399a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.689715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd07d52-ac76-4785-be75-1b3a5ebb399a None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.692299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 427/871] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:52.703990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01cc0-1401-4b67-9515-a6fae3376ad9 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.704726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01cc0-1401-4b67-9515-a6fae3376ad9 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.705663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e01cc0-1401-4b67-9515-a6fae3376ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.711166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e501-4714-467d-9fd1-a8f4b43a589c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.728643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-95e01cc0-1401-4b67-9515-a6fae3376ad9 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:52.730621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-95e01cc0-1401-4b67-9515-a6fae3376ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:52.748283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a26b1d-c95d-45d4-86e5-29b2eaf47265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.749302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a26b1d-c95d-45d4-86e5-29b2eaf47265 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.749733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a26b1d-c95d-45d4-86e5-29b2eaf47265 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.750232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a26b1d-c95d-45d4-86e5-29b2eaf47265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.758183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a26b1d-c95d-45d4-86e5-29b2eaf47265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.759831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a26b1d-c95d-45d4-86e5-29b2eaf47265 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.764587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-75a26b1d-c95d-45d4-86e5-29b2eaf47265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:52.775535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:52.776469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:52.777347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:52.777347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:52.777347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:52.777347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:52.777347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:52.777347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:52.777347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:52.777347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:52.779864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 445/872] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:52.785613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a26b1d-c95d-45d4-86e5-29b2eaf47265 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.828628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:52.830862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 428/873] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:52.855738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01cc0-1401-4b67-9515-a6fae3376ad9 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.901945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a26b1d-c95d-45d4-86e5-29b2eaf47265 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:52.941589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aeb96-be2c-4ebc-9758-4d428177f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:52.943082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aeb96-be2c-4ebc-9758-4d428177f2dc None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:52.943538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aeb96-be2c-4ebc-9758-4d428177f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:52.943953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aeb96-be2c-4ebc-9758-4d428177f2dc None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:52.944979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aeb96-be2c-4ebc-9758-4d428177f2dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:52.945440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aeb96-be2c-4ebc-9758-4d428177f2dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:52.947154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aeb96-be2c-4ebc-9758-4d428177f2dc None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:52.960824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 446/874] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:52.966402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aeb96-be2c-4ebc-9758-4d428177f2dc None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:52.974411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e01cc0-1401-4b67-9515-a6fae3376ad9 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.021204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1fa9e-a563-4615-800a-72ebd277f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.022534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1fa9e-a563-4615-800a-72ebd277f8ce None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.023071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1fa9e-a563-4615-800a-72ebd277f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.023744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1fa9e-a563-4615-800a-72ebd277f8ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.024949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1fa9e-a563-4615-800a-72ebd277f8ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.026514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1fa9e-a563-4615-800a-72ebd277f8ce None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-dde1fa9e-a563-4615-800a-72ebd277f8ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:53.044218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:53.045430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:37:53.046460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:53.050512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 429/875] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:53.054786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1fa9e-a563-4615-800a-72ebd277f8ce None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.087759 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.091107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.108821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aeb96-be2c-4ebc-9758-4d428177f2dc None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.160207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3bca7-4500-404f-b6d5-018c396a64e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.162294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3bca7-4500-404f-b6d5-018c396a64e1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.162804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3bca7-4500-404f-b6d5-018c396a64e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.163280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3bca7-4500-404f-b6d5-018c396a64e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.164292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3bca7-4500-404f-b6d5-018c396a64e1 None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6e8f3976dd524feeb4277e4ba4c8090b) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:53.164787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3bca7-4500-404f-b6d5-018c396a64e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.167243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3bca7-4500-404f-b6d5-018c396a64e1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.175200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 447/876] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:52 2022] GET /identity/v3/role_assignments?user.id=6e8f3976dd524feeb4277e4ba4c8090b&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:53.177272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a7acc-c88b-444e-b886-b737f4506425 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.177741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a7acc-c88b-444e-b886-b737f4506425 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.178193 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a7acc-c88b-444e-b886-b737f4506425 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.179229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1fa9e-a563-4615-800a-72ebd277f8ce None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.180088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 448/877] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:53.188774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc388a03-8c27-4789-821b-1b9186c1b05f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.189089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc388a03-8c27-4789-821b-1b9186c1b05f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.189346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc388a03-8c27-4789-821b-1b9186c1b05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.210887 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-dc388a03-8c27-4789-821b-1b9186c1b05f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:53.212115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dc388a03-8c27-4789-821b-1b9186c1b05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:53.228844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85847-5f0b-4c13-8874-2e7e6c0267b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.230051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85847-5f0b-4c13-8874-2e7e6c0267b1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.230656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85847-5f0b-4c13-8874-2e7e6c0267b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.230947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85847-5f0b-4c13-8874-2e7e6c0267b1 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.231686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85847-5f0b-4c13-8874-2e7e6c0267b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:53.232253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85847-5f0b-4c13-8874-2e7e6c0267b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.234155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85847-5f0b-4c13-8874-2e7e6c0267b1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.241991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 430/878] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:53.247884 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85847-5f0b-4c13-8874-2e7e6c0267b1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.300360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 449/879] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:37:53.328953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc388a03-8c27-4789-821b-1b9186c1b05f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:53.384819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.399976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85847-5f0b-4c13-8874-2e7e6c0267b1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.443919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d459ec3-2b5f-41ee-bb1e-a2093fc6da5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.444768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459ec3-2b5f-41ee-bb1e-a2093fc6da5b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.445179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459ec3-2b5f-41ee-bb1e-a2093fc6da5b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.445460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d459ec3-2b5f-41ee-bb1e-a2093fc6da5b None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.446350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d459ec3-2b5f-41ee-bb1e-a2093fc6da5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:53.446688 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d459ec3-2b5f-41ee-bb1e-a2093fc6da5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.448410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d459ec3-2b5f-41ee-bb1e-a2093fc6da5b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.453479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:53.455634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 431/880] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:37:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:53.467735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc388a03-8c27-4789-821b-1b9186c1b05f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:53.510919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba75894-fc78-4ca8-9ff2-cea70221260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:53.511625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75894-fc78-4ca8-9ff2-cea70221260b None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.511912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75894-fc78-4ca8-9ff2-cea70221260b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.512190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75894-fc78-4ca8-9ff2-cea70221260b None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.512942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba75894-fc78-4ca8-9ff2-cea70221260b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:53.514353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba75894-fc78-4ca8-9ff2-cea70221260b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:53.534428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 450/881] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:37:53 2022] POST /identity/v3/services => generated 269 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:37:53.987263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e5a3b-d7ab-40a3-a7bf-967dbd6c02ed None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.987798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e5a3b-d7ab-40a3-a7bf-967dbd6c02ed None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.987798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e5a3b-d7ab-40a3-a7bf-967dbd6c02ed None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:53.989486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 432/882] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:53.995149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e0a23-d0ff-4407-9c48-a20d70fb4144 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:53.996094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e0a23-d0ff-4407-9c48-a20d70fb4144 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:53.996576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e0a23-d0ff-4407-9c48-a20d70fb4144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.014614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-da8e0a23-d0ff-4407-9c48-a20d70fb4144 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:54.016200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-da8e0a23-d0ff-4407-9c48-a20d70fb4144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:54.098593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 451/883] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:37:54.121621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e5a3b-d7ab-40a3-a7bf-967dbd6c02ed None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.234314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e5a3b-d7ab-40a3-a7bf-967dbd6c02ed None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.271116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21473004-05de-4c45-8983-dcc0f0902d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.271904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21473004-05de-4c45-8983-dcc0f0902d6c None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.272184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21473004-05de-4c45-8983-dcc0f0902d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.272597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21473004-05de-4c45-8983-dcc0f0902d6c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.273401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21473004-05de-4c45-8983-dcc0f0902d6c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.274807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21473004-05de-4c45-8983-dcc0f0902d6c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-21473004-05de-4c45-8983-dcc0f0902d6c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:54.287731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:54.288806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:54.289637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 433/884] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:54.297242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e0a23-d0ff-4407-9c48-a20d70fb4144 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.384241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:54.411677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e0a23-d0ff-4407-9c48-a20d70fb4144 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.453594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60e8d-83f7-4d00-8464-9463dc12ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.454277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60e8d-83f7-4d00-8464-9463dc12ce06 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.454587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60e8d-83f7-4d00-8464-9463dc12ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.454863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60e8d-83f7-4d00-8464-9463dc12ce06 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.455589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa60e8d-83f7-4d00-8464-9463dc12ce06 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:54.455895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa60e8d-83f7-4d00-8464-9463dc12ce06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.457365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa60e8d-83f7-4d00-8464-9463dc12ce06 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.463532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 452/885] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:54.469673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21473004-05de-4c45-8983-dcc0f0902d6c None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.488459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:54.589766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21473004-05de-4c45-8983-dcc0f0902d6c None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.629528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c96208-04e0-47e0-9ef4-572c52fe46a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.630242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96208-04e0-47e0-9ef4-572c52fe46a9 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.630565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96208-04e0-47e0-9ef4-572c52fe46a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.630847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96208-04e0-47e0-9ef4-572c52fe46a9 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.631643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c96208-04e0-47e0-9ef4-572c52fe46a9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:54.631951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c96208-04e0-47e0-9ef4-572c52fe46a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.633425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c96208-04e0-47e0-9ef4-572c52fe46a9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.640000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 434/886] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:54.647113 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60e8d-83f7-4d00-8464-9463dc12ce06 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.761808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60e8d-83f7-4d00-8464-9463dc12ce06 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.796426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385e803-3253-4b96-a912-385f90c572de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.797078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385e803-3253-4b96-a912-385f90c572de None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.797359 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385e803-3253-4b96-a912-385f90c572de None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.797634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385e803-3253-4b96-a912-385f90c572de None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.798429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385e803-3253-4b96-a912-385f90c572de None admin] RBAC: Adding query filter params (interface=public, service_id=0bd77d20cf124d29ae03a204a41e6c80, region_id=RegionOne) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:54.798744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385e803-3253-4b96-a912-385f90c572de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.800086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385e803-3253-4b96-a912-385f90c572de None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.807897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 453/887] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/endpoints?service_id=0bd77d20cf124d29ae03a204a41e6c80&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:54.815493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c96208-04e0-47e0-9ef4-572c52fe46a9 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:54.897675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:54.920874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c96208-04e0-47e0-9ef4-572c52fe46a9 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:54.959439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f7de0-8138-44b6-a165-c701f80f0bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:54.960107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f7de0-8138-44b6-a165-c701f80f0bab None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:54.960394 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f7de0-8138-44b6-a165-c701f80f0bab None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:54.960670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f7de0-8138-44b6-a165-c701f80f0bab None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:54.961409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f7de0-8138-44b6-a165-c701f80f0bab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:54.962821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f7de0-8138-44b6-a165-c701f80f0bab None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:54.969117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 435/888] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jun 16 18:37:54 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:37:55.601220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bd978-b2d5-4128-91d7-d83ece6ba2e3 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.601783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bd978-b2d5-4128-91d7-d83ece6ba2e3 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.602027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bd978-b2d5-4128-91d7-d83ece6ba2e3 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.603936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 454/889] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:55.609491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b93c-3adb-4da0-98ce-ad16e56dc73d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.610419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b93c-3adb-4da0-98ce-ad16e56dc73d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.610939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b93c-3adb-4da0-98ce-ad16e56dc73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.628717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-22b2b93c-3adb-4da0-98ce-ad16e56dc73d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:55.630314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-22b2b93c-3adb-4da0-98ce-ad16e56dc73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:55.711912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 436/890] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:55.736259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bd978-b2d5-4128-91d7-d83ece6ba2e3 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:55.740668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:55.752476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bdb90-f018-48cd-8bb9-1288a402b63c None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.752762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bdb90-f018-48cd-8bb9-1288a402b63c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.753041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bdb90-f018-48cd-8bb9-1288a402b63c None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.755223 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 437/891] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:37:55.762771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c420a5-0590-443a-a846-b48aeeae5ed5 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.762978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c420a5-0590-443a-a846-b48aeeae5ed5 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.763226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c420a5-0590-443a-a846-b48aeeae5ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.787470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-17c420a5-0590-443a-a846-b48aeeae5ed5 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:55.788724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-17c420a5-0590-443a-a846-b48aeeae5ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:55.867651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bd978-b2d5-4128-91d7-d83ece6ba2e3 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:55.875341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 438/892] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:37:55.876983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af269-ee52-4d00-aa14-820894c1626e None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.877275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af269-ee52-4d00-aa14-820894c1626e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.877552 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af269-ee52-4d00-aa14-820894c1626e None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.879312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 439/893] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:55.886497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414d26-7b9c-4218-9109-16fabd21da19 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.887116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414d26-7b9c-4218-9109-16fabd21da19 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.887663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414d26-7b9c-4218-9109-16fabd21da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.894347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:55.911323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e8414d26-7b9c-4218-9109-16fabd21da19 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:55.912650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e8414d26-7b9c-4218-9109-16fabd21da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:55.920434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487720c5-b94c-4275-920d-bccea69e0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:55.921254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487720c5-b94c-4275-920d-bccea69e0c74 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:55.921537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487720c5-b94c-4275-920d-bccea69e0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:55.921812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487720c5-b94c-4275-920d-bccea69e0c74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:55.933179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487720c5-b94c-4275-920d-bccea69e0c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-487720c5-b94c-4275-920d-bccea69e0c74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:37:55.941835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:55.943091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 455/894] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jun 16 18:37:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:55.944294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487720c5-b94c-4275-920d-bccea69e0c74 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:55.991099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 440/895] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:56.003311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8414d26-7b9c-4218-9109-16fabd21da19 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.016232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.060554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487720c5-b94c-4275-920d-bccea69e0c74 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.105125 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43021bcc-52a8-4448-b688-fd83ae21a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.105907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43021bcc-52a8-4448-b688-fd83ae21a860 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.106146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43021bcc-52a8-4448-b688-fd83ae21a860 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.106445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43021bcc-52a8-4448-b688-fd83ae21a860 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.107170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43021bcc-52a8-4448-b688-fd83ae21a860 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.108636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43021bcc-52a8-4448-b688-fd83ae21a860 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.126424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 456/896] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:37:55 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:56.126424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43021bcc-52a8-4448-b688-fd83ae21a860 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.136357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8414d26-7b9c-4218-9109-16fabd21da19 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.182002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.197937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39387bab-e4d0-4c6c-aca9-9e9a24301997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.198952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387bab-e4d0-4c6c-aca9-9e9a24301997 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.199414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387bab-e4d0-4c6c-aca9-9e9a24301997 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.199845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387bab-e4d0-4c6c-aca9-9e9a24301997 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.200755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39387bab-e4d0-4c6c-aca9-9e9a24301997 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:56.201221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39387bab-e4d0-4c6c-aca9-9e9a24301997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.203509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39387bab-e4d0-4c6c-aca9-9e9a24301997 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.215330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 441/897] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jun 16 18:37:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:56.221787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39387bab-e4d0-4c6c-aca9-9e9a24301997 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.296019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43021bcc-52a8-4448-b688-fd83ae21a860 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.328051 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.344884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5727-430e-45f9-a361-a9088ccb1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.345708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5727-430e-45f9-a361-a9088ccb1b50 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.345994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5727-430e-45f9-a361-a9088ccb1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.346413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5727-430e-45f9-a361-a9088ccb1b50 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.347021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5727-430e-45f9-a361-a9088ccb1b50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.348426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5727-430e-45f9-a361-a9088ccb1b50 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-366d5727-430e-45f9-a361-a9088ccb1b50 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:56.360897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:56.361883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:56.362797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 457/898] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:56.365369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39387bab-e4d0-4c6c-aca9-9e9a24301997 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.372383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5727-430e-45f9-a361-a9088ccb1b50 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.407598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ec3e3-4491-4a9c-957f-1edb7753250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.408558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec3e3-4491-4a9c-957f-1edb7753250e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.408848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec3e3-4491-4a9c-957f-1edb7753250e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.409130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec3e3-4491-4a9c-957f-1edb7753250e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.429538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ec3e3-4491-4a9c-957f-1edb7753250e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.432283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ec3e3-4491-4a9c-957f-1edb7753250e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-011ec3e3-4491-4a9c-957f-1edb7753250e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:56.457034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:56.458557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:56.459425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:56.459425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:56.459425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:56.459425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:56.462367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 442/899] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:56.468262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ec3e3-4491-4a9c-957f-1edb7753250e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.510670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5727-430e-45f9-a361-a9088ccb1b50 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.540328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.559030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d3e8-b928-4cc7-9f38-5f87a09884b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.560067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d3e8-b928-4cc7-9f38-5f87a09884b4 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.560545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d3e8-b928-4cc7-9f38-5f87a09884b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.561023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21d3e8-b928-4cc7-9f38-5f87a09884b4 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.562979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21d3e8-b928-4cc7-9f38-5f87a09884b4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:56.563545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21d3e8-b928-4cc7-9f38-5f87a09884b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.565524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21d3e8-b928-4cc7-9f38-5f87a09884b4 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.573164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 458/900] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:56.582013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d3e8-b928-4cc7-9f38-5f87a09884b4 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.625096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ec3e3-4491-4a9c-957f-1edb7753250e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.650182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.666048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c3b42-6254-4b00-ac58-27bc09e34128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.666743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c3b42-6254-4b00-ac58-27bc09e34128 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.667031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c3b42-6254-4b00-ac58-27bc09e34128 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.667306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c3b42-6254-4b00-ac58-27bc09e34128 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.668065 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c3b42-6254-4b00-ac58-27bc09e34128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:56.668336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c3b42-6254-4b00-ac58-27bc09e34128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.669702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c3b42-6254-4b00-ac58-27bc09e34128 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.688396 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 443/901] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:56.689265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c3b42-6254-4b00-ac58-27bc09e34128 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.708479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21d3e8-b928-4cc7-9f38-5f87a09884b4 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.756828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8974f8-08f4-4ff6-90c7-d1a33d1429b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.757644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8974f8-08f4-4ff6-90c7-d1a33d1429b8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.758236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8974f8-08f4-4ff6-90c7-d1a33d1429b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.758802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8974f8-08f4-4ff6-90c7-d1a33d1429b8 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.759525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8974f8-08f4-4ff6-90c7-d1a33d1429b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:56.759837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8974f8-08f4-4ff6-90c7-d1a33d1429b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.761368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8974f8-08f4-4ff6-90c7-d1a33d1429b8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.768130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 459/902] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:56.776033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8974f8-08f4-4ff6-90c7-d1a33d1429b8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.813555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c3b42-6254-4b00-ac58-27bc09e34128 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.815329 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.854017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88688396-bfe0-4a12-94fd-7e49fa2f7030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.854915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88688396-bfe0-4a12-94fd-7e49fa2f7030 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.855196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88688396-bfe0-4a12-94fd-7e49fa2f7030 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.855471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88688396-bfe0-4a12-94fd-7e49fa2f7030 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.864001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88688396-bfe0-4a12-94fd-7e49fa2f7030 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.865539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88688396-bfe0-4a12-94fd-7e49fa2f7030 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-88688396-bfe0-4a12-94fd-7e49fa2f7030 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:37:56.884651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:56.885697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:37:56.886702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:56.890840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 444/903] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:56.891838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88688396-bfe0-4a12-94fd-7e49fa2f7030 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:56.921519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8974f8-08f4-4ff6-90c7-d1a33d1429b8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:56.944978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:56.968040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6410966-14fa-49e6-8e50-4b6ab5826580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:56.968972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6410966-14fa-49e6-8e50-4b6ab5826580 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:56.969408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6410966-14fa-49e6-8e50-4b6ab5826580 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:56.969843 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6410966-14fa-49e6-8e50-4b6ab5826580 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:56.971164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6410966-14fa-49e6-8e50-4b6ab5826580 None admin] RBAC: Adding query filter params (interface=public, service_id=abcf672b4a8c4ef6ad9e95346c483e88, region_id=RegionOne) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:56.971851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6410966-14fa-49e6-8e50-4b6ab5826580 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:56.973883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6410966-14fa-49e6-8e50-4b6ab5826580 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:56.984732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 460/904] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/endpoints?service_id=abcf672b4a8c4ef6ad9e95346c483e88&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:56.985877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6410966-14fa-49e6-8e50-4b6ab5826580 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.026634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88688396-bfe0-4a12-94fd-7e49fa2f7030 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.064806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29cd2-5ed7-46f4-baf9-a336b6fe979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.065455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29cd2-5ed7-46f4-baf9-a336b6fe979b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.065747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29cd2-5ed7-46f4-baf9-a336b6fe979b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.066025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29cd2-5ed7-46f4-baf9-a336b6fe979b None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.067445 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de29cd2-5ed7-46f4-baf9-a336b6fe979b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:57.067816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de29cd2-5ed7-46f4-baf9-a336b6fe979b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.069250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de29cd2-5ed7-46f4-baf9-a336b6fe979b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.102422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 445/905] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:57.103599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29cd2-5ed7-46f4-baf9-a336b6fe979b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.133805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.134945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6410966-14fa-49e6-8e50-4b6ab5826580 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.192749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b636f-35dc-44ff-b982-19c5c8a81477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.193552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b636f-35dc-44ff-b982-19c5c8a81477 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.193694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b636f-35dc-44ff-b982-19c5c8a81477 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.193956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b636f-35dc-44ff-b982-19c5c8a81477 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.194730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b636f-35dc-44ff-b982-19c5c8a81477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.196111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b636f-35dc-44ff-b982-19c5c8a81477 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.209999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 461/906] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jun 16 18:37:56 2022] GET /identity/v3/services => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:37:57.209999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca297e-97e1-4f25-8b41-d3311f09153f None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.209999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca297e-97e1-4f25-8b41-d3311f09153f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.209999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca297e-97e1-4f25-8b41-d3311f09153f None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.209999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 462/907] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:57.212359 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234c95-51c9-414d-857d-1075c45eb5ac None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.212643 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234c95-51c9-414d-857d-1075c45eb5ac None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.212916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234c95-51c9-414d-857d-1075c45eb5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.233137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-15234c95-51c9-414d-857d-1075c45eb5ac None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:57.234704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-15234c95-51c9-414d-857d-1075c45eb5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:57.238270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29cd2-5ed7-46f4-baf9-a336b6fe979b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.280962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81e93-d99e-4910-934b-fb7b5b67d220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.281627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81e93-d99e-4910-934b-fb7b5b67d220 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.281914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81e93-d99e-4910-934b-fb7b5b67d220 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.282198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81e93-d99e-4910-934b-fb7b5b67d220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.322905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.342139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 463/908] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:37:57.362130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234c95-51c9-414d-857d-1075c45eb5ac None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.377247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a81e93-d99e-4910-934b-fb7b5b67d220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.378751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a81e93-d99e-4910-934b-fb7b5b67d220 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.403418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.486787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234c95-51c9-414d-857d-1075c45eb5ac None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.530736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 446/909] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:37:57.538441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81e93-d99e-4910-934b-fb7b5b67d220 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.545869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9f41-4bdc-4d0f-aee9-771b67d9738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.546890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9f41-4bdc-4d0f-aee9-771b67d9738c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.547270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9f41-4bdc-4d0f-aee9-771b67d9738c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.547665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9f41-4bdc-4d0f-aee9-771b67d9738c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.548521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9f41-4bdc-4d0f-aee9-771b67d9738c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.550097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9f41-4bdc-4d0f-aee9-771b67d9738c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-fd7f9f41-4bdc-4d0f-aee9-771b67d9738c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:57.564264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:57.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 18:37:57.566716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:57.573482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 464/910] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:57.574842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9f41-4bdc-4d0f-aee9-771b67d9738c None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.623002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.670973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81e93-d99e-4910-934b-fb7b5b67d220 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.695636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.699173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9f41-4bdc-4d0f-aee9-771b67d9738c None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.711833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7a7a-6d22-43fb-9090-d54c47faf7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.713110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7a7a-6d22-43fb-9090-d54c47faf7a0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.713699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7a7a-6d22-43fb-9090-d54c47faf7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.714182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7a7a-6d22-43fb-9090-d54c47faf7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.726426 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7a7a-6d22-43fb-9090-d54c47faf7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.728113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e7a7a-6d22-43fb-9090-d54c47faf7a0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.740195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290fe65-043e-4f04-8eea-6fb93ecd3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.740863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290fe65-043e-4f04-8eea-6fb93ecd3e02 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.741144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290fe65-043e-4f04-8eea-6fb93ecd3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.741420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290fe65-043e-4f04-8eea-6fb93ecd3e02 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.742190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290fe65-043e-4f04-8eea-6fb93ecd3e02 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:57.742548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290fe65-043e-4f04-8eea-6fb93ecd3e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.743923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290fe65-043e-4f04-8eea-6fb93ecd3e02 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-230e7a7a-6d22-43fb-9090-d54c47faf7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:37:57.749099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:57.750256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:57.751544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:37:57.751544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:37:57.751544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:37:57.751544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:57.757309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 465/912] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:37:57.757309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290fe65-043e-4f04-8eea-6fb93ecd3e02 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.757583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 447/912] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:57.758830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7a7a-6d22-43fb-9090-d54c47faf7a0 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.879376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290fe65-043e-4f04-8eea-6fb93ecd3e02 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.881828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:57.897196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7a7a-6d22-43fb-9090-d54c47faf7a0 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:57.919156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe7c07-56c4-4d42-a233-1016fffe71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.919815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7c07-56c4-4d42-a233-1016fffe71ff None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.920160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7c07-56c4-4d42-a233-1016fffe71ff None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.920435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7c07-56c4-4d42-a233-1016fffe71ff None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.921190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7c07-56c4-4d42-a233-1016fffe71ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:57.921604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7c07-56c4-4d42-a233-1016fffe71ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.923164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7c07-56c4-4d42-a233-1016fffe71ff None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.934323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 466/913] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:57.935921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe7c07-56c4-4d42-a233-1016fffe71ff None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:57.944101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5d59a-9926-478d-a701-ffe48bd0a75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:57.945036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d59a-9926-478d-a701-ffe48bd0a75f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:57.945479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d59a-9926-478d-a701-ffe48bd0a75f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:57.945928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5d59a-9926-478d-a701-ffe48bd0a75f None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:57.946841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5d59a-9926-478d-a701-ffe48bd0a75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:57.947794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5d59a-9926-478d-a701-ffe48bd0a75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:57.949725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5d59a-9926-478d-a701-ffe48bd0a75f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:57.963686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 448/914] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:57.971391 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5d59a-9926-478d-a701-ffe48bd0a75f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.013293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.074848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe7c07-56c4-4d42-a233-1016fffe71ff None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.116174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5d59a-9926-478d-a701-ffe48bd0a75f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.119074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d8db7-7891-4131-84fc-7974ddca549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.120066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d8db7-7891-4131-84fc-7974ddca549b None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.120552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d8db7-7891-4131-84fc-7974ddca549b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.121034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d8db7-7891-4131-84fc-7974ddca549b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.122016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d8db7-7891-4131-84fc-7974ddca549b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.123643 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d8db7-7891-4131-84fc-7974ddca549b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.147259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 467/915] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jun 16 18:37:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:37:58.170717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec355e-88e8-4154-b450-94a07942f774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.171708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec355e-88e8-4154-b450-94a07942f774 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.172096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec355e-88e8-4154-b450-94a07942f774 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.172478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec355e-88e8-4154-b450-94a07942f774 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.182612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec355e-88e8-4154-b450-94a07942f774 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.184430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec355e-88e8-4154-b450-94a07942f774 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-88ec355e-88e8-4154-b450-94a07942f774 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:37:58.202419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:58.203405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:58.204579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:37:58.204579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:37:58.204579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:37:58.204579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:37:58.204579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:37:58.204579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:37:58.204579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:37:58.204579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:58.204579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 449/916] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:58.211808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d8db7-7891-4131-84fc-7974ddca549b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.247466 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.336668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d8db7-7891-4131-84fc-7974ddca549b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.380584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c94df8-d801-4585-b97b-528049fd5860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.381275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c94df8-d801-4585-b97b-528049fd5860 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.381560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c94df8-d801-4585-b97b-528049fd5860 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.381846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c94df8-d801-4585-b97b-528049fd5860 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.382694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c94df8-d801-4585-b97b-528049fd5860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:58.383011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c94df8-d801-4585-b97b-528049fd5860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.384473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c94df8-d801-4585-b97b-528049fd5860 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.399531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 468/917] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:58.405718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec355e-88e8-4154-b450-94a07942f774 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.419713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c722ef-c0ce-4b4a-8264-6aa629cd5852 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.420033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c722ef-c0ce-4b4a-8264-6aa629cd5852 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.420272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c722ef-c0ce-4b4a-8264-6aa629cd5852 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.422049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 469/918] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:58.428653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6848-5560-4b02-aeeb-fce2684b3daf None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.429230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6848-5560-4b02-aeeb-fce2684b3daf None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.429665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6848-5560-4b02-aeeb-fce2684b3daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.448822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-88be6848-5560-4b02-aeeb-fce2684b3daf None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:58.450298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-88be6848-5560-4b02-aeeb-fce2684b3daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:58.532996 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.537223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 470/919] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:37:58.548347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec355e-88e8-4154-b450-94a07942f774 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.561320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6848-5560-4b02-aeeb-fce2684b3daf None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.577544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:58.596629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc55c9-b8fd-45fe-9f60-01968af28a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.597305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc55c9-b8fd-45fe-9f60-01968af28a6a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.597590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc55c9-b8fd-45fe-9f60-01968af28a6a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.597867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc55c9-b8fd-45fe-9f60-01968af28a6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.599613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc55c9-b8fd-45fe-9f60-01968af28a6a None admin] RBAC: Adding query filter params (role.id=08ce118e12014a0dba5eda04a1cd8232, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6e8f3976dd524feeb4277e4ba4c8090b) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:58.599931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc55c9-b8fd-45fe-9f60-01968af28a6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.602232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc55c9-b8fd-45fe-9f60-01968af28a6a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.610427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 450/920] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/role_assignments?user.id=6e8f3976dd524feeb4277e4ba4c8090b&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=08ce118e12014a0dba5eda04a1cd8232 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:58.696027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6848-5560-4b02-aeeb-fce2684b3daf None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.738910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e4d3a-e3c5-49a5-8b31-46b9802c4149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.740600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e4d3a-e3c5-49a5-8b31-46b9802c4149 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.741107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e4d3a-e3c5-49a5-8b31-46b9802c4149 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.741569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e4d3a-e3c5-49a5-8b31-46b9802c4149 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.742435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e4d3a-e3c5-49a5-8b31-46b9802c4149 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.744034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e4d3a-e3c5-49a5-8b31-46b9802c4149 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e66e4d3a-e3c5-49a5-8b31-46b9802c4149 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:58.758748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:58.759822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:37:58.760688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 471/921] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:37:58.766345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc55c9-b8fd-45fe-9f60-01968af28a6a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:58.880649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc55c9-b8fd-45fe-9f60-01968af28a6a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:58.917834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc44066-e2ee-424d-b553-080874b00285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:58.918585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc44066-e2ee-424d-b553-080874b00285 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:58.918866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc44066-e2ee-424d-b553-080874b00285 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:58.919193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc44066-e2ee-424d-b553-080874b00285 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:58.919906 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc44066-e2ee-424d-b553-080874b00285 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:58.920211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc44066-e2ee-424d-b553-080874b00285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:58.921581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc44066-e2ee-424d-b553-080874b00285 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:58.927171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 451/922] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:58.939555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e4d3a-e3c5-49a5-8b31-46b9802c4149 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.028261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.052888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e4d3a-e3c5-49a5-8b31-46b9802c4149 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.090300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b6d72-7f9c-4f7b-81e7-d36a625700ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.091014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b6d72-7f9c-4f7b-81e7-d36a625700ca None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.091299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b6d72-7f9c-4f7b-81e7-d36a625700ca None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.091579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b6d72-7f9c-4f7b-81e7-d36a625700ca None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.092306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b6d72-7f9c-4f7b-81e7-d36a625700ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:59.092617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b6d72-7f9c-4f7b-81e7-d36a625700ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.093980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b6d72-7f9c-4f7b-81e7-d36a625700ca None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.100010 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 472/923] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:37:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:59.106665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc44066-e2ee-424d-b553-080874b00285 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.127143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.219911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc44066-e2ee-424d-b553-080874b00285 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.255603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9701e9-55ba-46f0-8a04-b75db9cc51ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.256264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9701e9-55ba-46f0-8a04-b75db9cc51ab None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.256542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9701e9-55ba-46f0-8a04-b75db9cc51ab None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.256805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9701e9-55ba-46f0-8a04-b75db9cc51ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.257592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9701e9-55ba-46f0-8a04-b75db9cc51ab None admin] RBAC: Adding query filter params (interface=public, service_id=0e7641cff4ce4678b86d4817536906cc, region_id=RegionOne) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:59.257906 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9701e9-55ba-46f0-8a04-b75db9cc51ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.259300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9701e9-55ba-46f0-8a04-b75db9cc51ab None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.269798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 452/924] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/endpoints?service_id=0e7641cff4ce4678b86d4817536906cc&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:59.271723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b6d72-7f9c-4f7b-81e7-d36a625700ca None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.377762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b6d72-7f9c-4f7b-81e7-d36a625700ca None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.421503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7075d-26c7-4a1d-824f-89541dab0a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.422217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7075d-26c7-4a1d-824f-89541dab0a7d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.422552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7075d-26c7-4a1d-824f-89541dab0a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.422871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7075d-26c7-4a1d-824f-89541dab0a7d None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.423539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7075d-26c7-4a1d-824f-89541dab0a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.425078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7075d-26c7-4a1d-824f-89541dab0a7d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.433259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 473/925] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:37:59.500593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36c87-4674-49c8-9141-0e1592b372c1 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.500923 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36c87-4674-49c8-9141-0e1592b372c1 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.501511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36c87-4674-49c8-9141-0e1592b372c1 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.502900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 453/926] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:37:59.509351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f310b5-6c6b-4dea-b2dd-baa393b2fb5e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.509653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f310b5-6c6b-4dea-b2dd-baa393b2fb5e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.509941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f310b5-6c6b-4dea-b2dd-baa393b2fb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.516290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.529513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-09f310b5-6c6b-4dea-b2dd-baa393b2fb5e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:37:59.530783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-09f310b5-6c6b-4dea-b2dd-baa393b2fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:37:59.608486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 474/927] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:37:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:37:59.631325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a36c87-4674-49c8-9141-0e1592b372c1 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.719649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.746314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a36c87-4674-49c8-9141-0e1592b372c1 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.782810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae6cd-ead5-4ad0-9e94-77a92ff52074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.784333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae6cd-ead5-4ad0-9e94-77a92ff52074 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.784754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae6cd-ead5-4ad0-9e94-77a92ff52074 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.785164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae6cd-ead5-4ad0-9e94-77a92ff52074 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.786524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae6cd-ead5-4ad0-9e94-77a92ff52074 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.788044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae6cd-ead5-4ad0-9e94-77a92ff52074 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-2d0ae6cd-ead5-4ad0-9e94-77a92ff52074 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:37:59.800885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:37:59.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 18:37:59.803611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:37:59.806097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 454/928] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:37:59.811943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f310b5-6c6b-4dea-b2dd-baa393b2fb5e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:37:59.921581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f310b5-6c6b-4dea-b2dd-baa393b2fb5e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:37:59.959695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b3532-44c6-4f66-a65d-57de00335da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:37:59.960372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b3532-44c6-4f66-a65d-57de00335da5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:37:59.960654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b3532-44c6-4f66-a65d-57de00335da5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:37:59.960928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b3532-44c6-4f66-a65d-57de00335da5 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:37:59.961640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b3532-44c6-4f66-a65d-57de00335da5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:37:59.961944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b3532-44c6-4f66-a65d-57de00335da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:37:59.963352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b3532-44c6-4f66-a65d-57de00335da5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:37:59.964597 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:59.969413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 475/929] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:37:59.975907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae6cd-ead5-4ad0-9e94-77a92ff52074 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:00.089295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae6cd-ead5-4ad0-9e94-77a92ff52074 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.126582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fdeb5-f61f-42f6-a90f-1b49bb90af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.127250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fdeb5-f61f-42f6-a90f-1b49bb90af90 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.127531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fdeb5-f61f-42f6-a90f-1b49bb90af90 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.127800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fdeb5-f61f-42f6-a90f-1b49bb90af90 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.128505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fdeb5-f61f-42f6-a90f-1b49bb90af90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:00.128810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fdeb5-f61f-42f6-a90f-1b49bb90af90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.130231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fdeb5-f61f-42f6-a90f-1b49bb90af90 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.135829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 455/930] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:37:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:00.141316 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b3532-44c6-4f66-a65d-57de00335da5 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:00.250348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b3532-44c6-4f66-a65d-57de00335da5 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.291845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576574f-bd92-4cdd-b5e2-dd53e4dafd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.292506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576574f-bd92-4cdd-b5e2-dd53e4dafd0b None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.292790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576574f-bd92-4cdd-b5e2-dd53e4dafd0b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.293066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576574f-bd92-4cdd-b5e2-dd53e4dafd0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.293819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576574f-bd92-4cdd-b5e2-dd53e4dafd0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.295206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576574f-bd92-4cdd-b5e2-dd53e4dafd0b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.317691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 476/931] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:00.480876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e825c0-2316-4a78-9ddb-573d38d021ae None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.481236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e825c0-2316-4a78-9ddb-573d38d021ae None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.481492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e825c0-2316-4a78-9ddb-573d38d021ae None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.483275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 456/932] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:00.489104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed6f5-70ce-4f09-b1cf-68a06832a9fc None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.489411 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed6f5-70ce-4f09-b1cf-68a06832a9fc None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.489730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed6f5-70ce-4f09-b1cf-68a06832a9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.511119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-99fed6f5-70ce-4f09-b1cf-68a06832a9fc None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:00.512325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-99fed6f5-70ce-4f09-b1cf-68a06832a9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:00.568319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:00.594218 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 477/933] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:00.617289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e825c0-2316-4a78-9ddb-573d38d021ae None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:00.631466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:00.733096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e825c0-2316-4a78-9ddb-573d38d021ae None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.768702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.769289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.769570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.769839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.770630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.772079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.773953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WARNING keystone.server.flask.common [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 18:38:00.793828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.sql.core [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 18:38:00.793828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 18:38:00.793828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [parameters: {'id': '47af30bd4663486ba586c937494163de', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 18:38:00.793828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86898) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 47af30bd4663486ba586c937494163de.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 47af30bd4663486ba586c937494163de. Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:38:00.801832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application result.read() Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 18:38:00.802662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application yield resource Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise self.value Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application session.commit() Jun 16 18:38:00.803595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.session.flush() Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application compat.raise_( Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 18:38:00.804474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 18:38:00.805351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application result.read() Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:38:00.806133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [parameters: {'id': '47af30bd4663486ba586c937494163de', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:00.808509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:00.809492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 47af30bd4663486ba586c937494163de. Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:00.810664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 457/934] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Jun 16 18:38:00 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:00.811323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fed6f5-70ce-4f09-b1cf-68a06832a9fc None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:00.924824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fed6f5-70ce-4f09-b1cf-68a06832a9fc None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:00.964683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd83c5d-5636-4514-8ce6-4f9c63139176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:00.965512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd83c5d-5636-4514-8ce6-4f9c63139176 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:00.965860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd83c5d-5636-4514-8ce6-4f9c63139176 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:00.966144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd83c5d-5636-4514-8ce6-4f9c63139176 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:00.975202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd83c5d-5636-4514-8ce6-4f9c63139176 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:00.976718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd83c5d-5636-4514-8ce6-4f9c63139176 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-cdd83c5d-5636-4514-8ce6-4f9c63139176 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:00.992412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:00.994551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:00.996743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:00.996743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:00.996743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:00.996743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:00.996743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:00.996743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:00.996743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:00.996743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:00.996743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 478/935] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:01.003899 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.027974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b750295-77e7-4a03-86c6-68cd148f3403 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.028162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b750295-77e7-4a03-86c6-68cd148f3403 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.028440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b750295-77e7-4a03-86c6-68cd148f3403 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.030063 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 479/936] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:01.035055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639a2b-ce32-483d-ac50-d082a003ec94 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.035338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639a2b-ce32-483d-ac50-d082a003ec94 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.035642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639a2b-ce32-483d-ac50-d082a003ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.053729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-14639a2b-ce32-483d-ac50-d082a003ec94 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:01.055028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-14639a2b-ce32-483d-ac50-d082a003ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:01.090913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.100387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.129232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cb9d8-747f-4482-958e-e76a41d5e5df None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.146422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 480/937] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:01.168867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639a2b-ce32-483d-ac50-d082a003ec94 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.174942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b45f5-9b3c-483b-a221-cc592d64bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.175953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b45f5-9b3c-483b-a221-cc592d64bf79 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.176533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b45f5-9b3c-483b-a221-cc592d64bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.177003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b45f5-9b3c-483b-a221-cc592d64bf79 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.178073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b45f5-9b3c-483b-a221-cc592d64bf79 None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:01.178628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b45f5-9b3c-483b-a221-cc592d64bf79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:01.180650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b45f5-9b3c-483b-a221-cc592d64bf79 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:01.204047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 458/938] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:01.291880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639a2b-ce32-483d-ac50-d082a003ec94 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.332210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ada69-473d-499c-9b37-92d41f2ae9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.334034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ada69-473d-499c-9b37-92d41f2ae9ec None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.334584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ada69-473d-499c-9b37-92d41f2ae9ec None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.335094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ada69-473d-499c-9b37-92d41f2ae9ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.347785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ada69-473d-499c-9b37-92d41f2ae9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-974ada69-473d-499c-9b37-92d41f2ae9ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:01.357259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:01.358252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:01.359114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:01.362080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 481/939] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:01.369157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b45f5-9b3c-483b-a221-cc592d64bf79 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.485357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b45f5-9b3c-483b-a221-cc592d64bf79 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.514794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.528636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23043385-6b72-4d2c-b701-ce41f2a2b917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.529310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23043385-6b72-4d2c-b701-ce41f2a2b917 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.529719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23043385-6b72-4d2c-b701-ce41f2a2b917 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.530000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23043385-6b72-4d2c-b701-ce41f2a2b917 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.530885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23043385-6b72-4d2c-b701-ce41f2a2b917 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:01.531190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23043385-6b72-4d2c-b701-ce41f2a2b917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:01.532566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23043385-6b72-4d2c-b701-ce41f2a2b917 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:01.542228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 459/940] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:01.547898 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ada69-473d-499c-9b37-92d41f2ae9ec None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.582304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.659973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ada69-473d-499c-9b37-92d41f2ae9ec None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.705859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1c119-b94d-493f-9ee8-958b68737c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.706723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1c119-b94d-493f-9ee8-958b68737c41 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.707006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1c119-b94d-493f-9ee8-958b68737c41 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.707281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1c119-b94d-493f-9ee8-958b68737c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.719902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1c119-b94d-493f-9ee8-958b68737c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:01.721379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1c119-b94d-493f-9ee8-958b68737c41 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-37c1c119-b94d-493f-9ee8-958b68737c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:01.740516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:01.742615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:01.744717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:01.744717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:01.744717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:01.744717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:01.744717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 482/941] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:01.747367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5cf9c-e866-4009-b8ff-76decb2bffa2 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.747656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5cf9c-e866-4009-b8ff-76decb2bffa2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.747932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5cf9c-e866-4009-b8ff-76decb2bffa2 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.749441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 460/942] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:01.751405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1c119-b94d-493f-9ee8-958b68737c41 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.754547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01baa2-5622-40c0-8ab9-d50cac5c8e9e None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.754836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01baa2-5622-40c0-8ab9-d50cac5c8e9e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.755112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01baa2-5622-40c0-8ab9-d50cac5c8e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.776498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ef01baa2-5622-40c0-8ab9-d50cac5c8e9e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:01.779173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ef01baa2-5622-40c0-8ab9-d50cac5c8e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:01.852674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.875621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 461/943] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:01.878339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1c119-b94d-493f-9ee8-958b68737c41 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:01.898359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01baa2-5622-40c0-8ab9-d50cac5c8e9e None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:01.921972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd43b-22be-4711-826e-8cdb20a25dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:01.922936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd43b-22be-4711-826e-8cdb20a25dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:01.923222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd43b-22be-4711-826e-8cdb20a25dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:01.923499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd43b-22be-4711-826e-8cdb20a25dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:01.924521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cd43b-22be-4711-826e-8cdb20a25dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:01.924834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cd43b-22be-4711-826e-8cdb20a25dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:01.926816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cd43b-22be-4711-826e-8cdb20a25dd7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:01.943883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 483/944] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:01.949452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd43b-22be-4711-826e-8cdb20a25dd7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.043340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01baa2-5622-40c0-8ab9-d50cac5c8e9e None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.058174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd43b-22be-4711-826e-8cdb20a25dd7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.068528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.094823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b36a-405c-4f4d-b649-ad96aa90f8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.096033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b36a-405c-4f4d-b649-ad96aa90f8ca None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.096548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b36a-405c-4f4d-b649-ad96aa90f8ca None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.097017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b36a-405c-4f4d-b649-ad96aa90f8ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.097133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06945b2c-d086-4e2b-b45e-2c5ef7a5dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.098016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06945b2c-d086-4e2b-b45e-2c5ef7a5dad3 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.098124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454b36a-405c-4f4d-b649-ad96aa90f8ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.098927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06945b2c-d086-4e2b-b45e-2c5ef7a5dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.099209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06945b2c-d086-4e2b-b45e-2c5ef7a5dad3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.100707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454b36a-405c-4f4d-b649-ad96aa90f8ca None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.109770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06945b2c-d086-4e2b-b45e-2c5ef7a5dad3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.111426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06945b2c-d086-4e2b-b45e-2c5ef7a5dad3 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-4454b36a-405c-4f4d-b649-ad96aa90f8ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:02.117897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:02.119018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:02.119853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:02.127645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 462/945] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:02.129184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b36a-405c-4f4d-b649-ad96aa90f8ca None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-06945b2c-d086-4e2b-b45e-2c5ef7a5dad3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:02.130457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:02.131369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:02.132297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:02.136896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 484/946] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:38:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:02.138271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06945b2c-d086-4e2b-b45e-2c5ef7a5dad3 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.140941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.251346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06945b2c-d086-4e2b-b45e-2c5ef7a5dad3 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.268496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b36a-405c-4f4d-b649-ad96aa90f8ca None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.288159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907efb1b-1bd5-4bb4-8f5d-71d8820d5751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.288835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907efb1b-1bd5-4bb4-8f5d-71d8820d5751 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.289117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907efb1b-1bd5-4bb4-8f5d-71d8820d5751 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.289389 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907efb1b-1bd5-4bb4-8f5d-71d8820d5751 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.290234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907efb1b-1bd5-4bb4-8f5d-71d8820d5751 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:02.290590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907efb1b-1bd5-4bb4-8f5d-71d8820d5751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.292536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907efb1b-1bd5-4bb4-8f5d-71d8820d5751 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.307200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff5fb1-43a9-4d89-87d9-5fcb35a59ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.308238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5fb1-43a9-4d89-87d9-5fcb35a59ac0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.308747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5fb1-43a9-4d89-87d9-5fcb35a59ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.309218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5fb1-43a9-4d89-87d9-5fcb35a59ac0 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.310115 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff5fb1-43a9-4d89-87d9-5fcb35a59ac0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:02.310645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff5fb1-43a9-4d89-87d9-5fcb35a59ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.312216 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff5fb1-43a9-4d89-87d9-5fcb35a59ac0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.322417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 485/947] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:02.322417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907efb1b-1bd5-4bb4-8f5d-71d8820d5751 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.323102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 463/948] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:02.324684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff5fb1-43a9-4d89-87d9-5fcb35a59ac0 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.373002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.388429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.434175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff5fb1-43a9-4d89-87d9-5fcb35a59ac0 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.435400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907efb1b-1bd5-4bb4-8f5d-71d8820d5751 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.474593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801cb0c-24e6-4768-a8cd-b95e184b2dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.475609 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801cb0c-24e6-4768-a8cd-b95e184b2dfd None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.476040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801cb0c-24e6-4768-a8cd-b95e184b2dfd None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.476489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801cb0c-24e6-4768-a8cd-b95e184b2dfd None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.477364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801cb0c-24e6-4768-a8cd-b95e184b2dfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:02.477784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801cb0c-24e6-4768-a8cd-b95e184b2dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.478982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d8e39-a195-42cd-bbdf-652aa158596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.479478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801cb0c-24e6-4768-a8cd-b95e184b2dfd None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.480130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d8e39-a195-42cd-bbdf-652aa158596e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.480554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d8e39-a195-42cd-bbdf-652aa158596e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.481077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d8e39-a195-42cd-bbdf-652aa158596e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.491111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 464/949] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:02.492368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801cb0c-24e6-4768-a8cd-b95e184b2dfd None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.493860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d8e39-a195-42cd-bbdf-652aa158596e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.495684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d8e39-a195-42cd-bbdf-652aa158596e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-379d8e39-a195-42cd-bbdf-652aa158596e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:02.517846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:02.518771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:02.519623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:02.519623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:02.519623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:02.519623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:02.521430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 486/950] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:02.528525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d8e39-a195-42cd-bbdf-652aa158596e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.631940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801cb0c-24e6-4768-a8cd-b95e184b2dfd None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.642351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.646303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d8e39-a195-42cd-bbdf-652aa158596e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.660443 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.670688 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301948d8-57b3-4cbc-af43-3205f2080e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.671598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301948d8-57b3-4cbc-af43-3205f2080e07 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.672091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301948d8-57b3-4cbc-af43-3205f2080e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.672368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301948d8-57b3-4cbc-af43-3205f2080e07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.673175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301948d8-57b3-4cbc-af43-3205f2080e07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.674598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301948d8-57b3-4cbc-af43-3205f2080e07 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.683294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ddf81-0c74-43e0-b8d2-b5732a3e63b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.684154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ddf81-0c74-43e0-b8d2-b5732a3e63b0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.684473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ddf81-0c74-43e0-b8d2-b5732a3e63b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.684789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ddf81-0c74-43e0-b8d2-b5732a3e63b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.685690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ddf81-0c74-43e0-b8d2-b5732a3e63b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:02.686064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ddf81-0c74-43e0-b8d2-b5732a3e63b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.688078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ddf81-0c74-43e0-b8d2-b5732a3e63b0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.702861 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 465/951] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:02.704836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ed8a-9da9-4462-9a74-14c1c5c568d2 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.705379 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ed8a-9da9-4462-9a74-14c1c5c568d2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.705840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ed8a-9da9-4462-9a74-14c1c5c568d2 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.711765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 487/952] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:02.712318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 466/953] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:02.713363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ddf81-0c74-43e0-b8d2-b5732a3e63b0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.714327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967282c8-6caa-4ac6-a7b6-07b25380f0da None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.714826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967282c8-6caa-4ac6-a7b6-07b25380f0da None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.715300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967282c8-6caa-4ac6-a7b6-07b25380f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.737382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-967282c8-6caa-4ac6-a7b6-07b25380f0da None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:02.740352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-967282c8-6caa-4ac6-a7b6-07b25380f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:02.840922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 467/954] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:02.864655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967282c8-6caa-4ac6-a7b6-07b25380f0da None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.880309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ddf81-0c74-43e0-b8d2-b5732a3e63b0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.921080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c63a5-19b1-4910-8e78-35e4dbc7a443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:02.922519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c63a5-19b1-4910-8e78-35e4dbc7a443 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:02.922951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c63a5-19b1-4910-8e78-35e4dbc7a443 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:02.923497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c63a5-19b1-4910-8e78-35e4dbc7a443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:02.933151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c63a5-19b1-4910-8e78-35e4dbc7a443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:02.935267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c63a5-19b1-4910-8e78-35e4dbc7a443 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e01c63a5-19b1-4910-8e78-35e4dbc7a443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:02.950809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:02.951811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:02.952749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:02.952749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:02.952749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:02.952749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:02.952749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:02.952749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:02.952749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:02.952749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:02.955563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 488/955] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:02.961465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c63a5-19b1-4910-8e78-35e4dbc7a443 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:02.982940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:02.997666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967282c8-6caa-4ac6-a7b6-07b25380f0da None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:02.999415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.048052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0885f-e9df-4eb4-948b-2f9a167667e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.049143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0885f-e9df-4eb4-948b-2f9a167667e3 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.049422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0885f-e9df-4eb4-948b-2f9a167667e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.049691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0885f-e9df-4eb4-948b-2f9a167667e3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.050346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0885f-e9df-4eb4-948b-2f9a167667e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.052941 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0885f-e9df-4eb4-948b-2f9a167667e3 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-ade0885f-e9df-4eb4-948b-2f9a167667e3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:03.067471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:03.068670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:03.069546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:03.072231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 468/956] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:03.078225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0885f-e9df-4eb4-948b-2f9a167667e3 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.088587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c63a5-19b1-4910-8e78-35e4dbc7a443 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.128698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456f211-cddc-497d-96c3-d94333217412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.129395 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456f211-cddc-497d-96c3-d94333217412 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.129713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456f211-cddc-497d-96c3-d94333217412 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.129989 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456f211-cddc-497d-96c3-d94333217412 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.130829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456f211-cddc-497d-96c3-d94333217412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:03.131147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456f211-cddc-497d-96c3-d94333217412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.132573 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456f211-cddc-497d-96c3-d94333217412 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.151544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 489/957] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:03.152887 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456f211-cddc-497d-96c3-d94333217412 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.213886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0885f-e9df-4eb4-948b-2f9a167667e3 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.260763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d8ec4-8257-4504-b855-756b1aaaa6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.262075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8ec4-8257-4504-b855-756b1aaaa6d7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.263013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8ec4-8257-4504-b855-756b1aaaa6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.263509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8ec4-8257-4504-b855-756b1aaaa6d7 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.264456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d8ec4-8257-4504-b855-756b1aaaa6d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:03.264999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d8ec4-8257-4504-b855-756b1aaaa6d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.267518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d8ec4-8257-4504-b855-756b1aaaa6d7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.269922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.280355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 469/958] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:03.282458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d8ec4-8257-4504-b855-756b1aaaa6d7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.290321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456f211-cddc-497d-96c3-d94333217412 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.303888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:03.336466 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0fef3-79b5-4c37-a102-1fbac84f3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.338239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0fef3-79b5-4c37-a102-1fbac84f3d68 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.338729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0fef3-79b5-4c37-a102-1fbac84f3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.339160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0fef3-79b5-4c37-a102-1fbac84f3d68 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6e8f3976dd524feeb4277e4ba4c8090b/roles/08ce118e12014a0dba5eda04a1cd8232` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.342042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0fef3-79b5-4c37-a102-1fbac84f3d68 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=6e8f3976dd524feeb4277e4ba4c8090b, role_id=08ce118e12014a0dba5eda04a1cd8232)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.344229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0fef3-79b5-4c37-a102-1fbac84f3d68 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.370419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 490/959] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:38:03 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6e8f3976dd524feeb4277e4ba4c8090b/roles/08ce118e12014a0dba5eda04a1cd8232 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:38:03.419652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d8ec4-8257-4504-b855-756b1aaaa6d7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.459701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a995805-27ab-4b6f-9fa2-aee1f8576baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.460402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a995805-27ab-4b6f-9fa2-aee1f8576baf None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.460684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a995805-27ab-4b6f-9fa2-aee1f8576baf None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.460958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a995805-27ab-4b6f-9fa2-aee1f8576baf None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.461687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a995805-27ab-4b6f-9fa2-aee1f8576baf None admin] RBAC: Adding query filter params (type=compute) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:03.461991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a995805-27ab-4b6f-9fa2-aee1f8576baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.463446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a995805-27ab-4b6f-9fa2-aee1f8576baf None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.469675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 470/960] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:03.561631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e302-3877-41f3-a07d-71f41c58da96 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.561974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e302-3877-41f3-a07d-71f41c58da96 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.562202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e302-3877-41f3-a07d-71f41c58da96 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.564280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 491/961] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:03.570771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437202f-e554-4fb0-8398-5b1cb9439701 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.571084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437202f-e554-4fb0-8398-5b1cb9439701 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.571331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437202f-e554-4fb0-8398-5b1cb9439701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.592124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-3437202f-e554-4fb0-8398-5b1cb9439701 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:03.593346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-3437202f-e554-4fb0-8398-5b1cb9439701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:03.675984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 471/962] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:03.703006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654e302-3877-41f3-a07d-71f41c58da96 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.816959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654e302-3877-41f3-a07d-71f41c58da96 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:03.854140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:03.854926 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:03.855208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:03.855485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:03.856221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:03.857728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:03.859202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING keystone.server.flask.common [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 18:38:03.875793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.sql.core [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 18:38:03.875793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 18:38:03.875793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [parameters: {'user_id': 'f36dffb7e09742d8a4682535df9811e3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 18:38:03.875793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86897) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application result.read() Jun 16 18:38:03.893814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:38:03.894853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application yield resource Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application next(self.gen) Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise self.value Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application session.commit() Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 18:38:03.896377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self.session.flush() Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application compat.raise_( Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 18:38:03.897259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 18:38:03.898238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application conn.query(q) Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application result.read() Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 18:38:03.900884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f36dffb7e09742d8a4682535df9811e3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:03.906417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 18:38:03.915710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 18:38:03.917261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 18:38:03.917261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 18:38:03.917261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 18:38:03.917261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 18:38:03.917261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 18:38:03.917261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:03.917261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 492/963] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jun 16 18:38:03 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:03.917757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437202f-e554-4fb0-8398-5b1cb9439701 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:03.926198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.019306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437202f-e554-4fb0-8398-5b1cb9439701 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.058151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65822064-8278-42c1-b163-0ac85c7daeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.059018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65822064-8278-42c1-b163-0ac85c7daeda None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.059306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65822064-8278-42c1-b163-0ac85c7daeda None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.059583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65822064-8278-42c1-b163-0ac85c7daeda None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.068446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65822064-8278-42c1-b163-0ac85c7daeda None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.070919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65822064-8278-42c1-b163-0ac85c7daeda None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-65822064-8278-42c1-b163-0ac85c7daeda None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:04.099830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:04.100837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 18:38:04.101792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:04.102841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 472/964] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:04.109330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:04.131396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:04.225131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b10f4-a067-42dc-9dfe-baf396078673 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:04.261200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420a1d0-3514-4207-9d4e-9176f38fc6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:04.262174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420a1d0-3514-4207-9d4e-9176f38fc6c5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.262914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420a1d0-3514-4207-9d4e-9176f38fc6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.263362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420a1d0-3514-4207-9d4e-9176f38fc6c5 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.264409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420a1d0-3514-4207-9d4e-9176f38fc6c5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:04.264898 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420a1d0-3514-4207-9d4e-9176f38fc6c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:04.266783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420a1d0-3514-4207-9d4e-9176f38fc6c5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:04.307918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 493/965] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jun 16 18:38:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:04.918434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fc5dc-4a48-487e-b54f-8acd8660ecba None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.918626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fc5dc-4a48-487e-b54f-8acd8660ecba None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.918928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fc5dc-4a48-487e-b54f-8acd8660ecba None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.920283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 473/966] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:04.925776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0840aa3-746f-4deb-80f0-91911f230103 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:04.926071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0840aa3-746f-4deb-80f0-91911f230103 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:04.926373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0840aa3-746f-4deb-80f0-91911f230103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:04.943601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d0840aa3-746f-4deb-80f0-91911f230103 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:04.945103 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d0840aa3-746f-4deb-80f0-91911f230103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:05.019820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 494/967] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:05.042153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fc5dc-4a48-487e-b54f-8acd8660ecba None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.115315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:05.148295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fc5dc-4a48-487e-b54f-8acd8660ecba None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.182868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab763b4b-6dbe-4eaa-b43a-10d891bc5e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.188565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab763b4b-6dbe-4eaa-b43a-10d891bc5e42 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.188565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab763b4b-6dbe-4eaa-b43a-10d891bc5e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.188565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab763b4b-6dbe-4eaa-b43a-10d891bc5e42 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.188565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab763b4b-6dbe-4eaa-b43a-10d891bc5e42 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:05.188565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab763b4b-6dbe-4eaa-b43a-10d891bc5e42 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-ab763b4b-6dbe-4eaa-b43a-10d891bc5e42 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:05.200489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:05.201562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:05.202452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:05.204029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 474/968] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:05.207659 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0840aa3-746f-4deb-80f0-91911f230103 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.210447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:05.311632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0840aa3-746f-4deb-80f0-91911f230103 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.350817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21052-96e2-44d1-8cd9-fd6863a8c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.351487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21052-96e2-44d1-8cd9-fd6863a8c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.351770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21052-96e2-44d1-8cd9-fd6863a8c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.352043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e21052-96e2-44d1-8cd9-fd6863a8c4e5 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.352745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21052-96e2-44d1-8cd9-fd6863a8c4e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:05.353050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21052-96e2-44d1-8cd9-fd6863a8c4e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:05.354425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e21052-96e2-44d1-8cd9-fd6863a8c4e5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:05.359662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 495/969] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:05.365500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab763b4b-6dbe-4eaa-b43a-10d891bc5e42 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.469007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab763b4b-6dbe-4eaa-b43a-10d891bc5e42 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.513700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6d09b-2918-4ddf-adc9-2d03568a793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.514374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6d09b-2918-4ddf-adc9-2d03568a793a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.514686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6d09b-2918-4ddf-adc9-2d03568a793a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.514964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6d09b-2918-4ddf-adc9-2d03568a793a None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.515674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6d09b-2918-4ddf-adc9-2d03568a793a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:05.515978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6d09b-2918-4ddf-adc9-2d03568a793a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:05.517346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6d09b-2918-4ddf-adc9-2d03568a793a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:05.519543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:05.526550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 475/970] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:05.529334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21052-96e2-44d1-8cd9-fd6863a8c4e5 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.601245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:05.615731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef7711-ddd5-403d-9291-b1d6d1095d5c None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.616060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef7711-ddd5-403d-9291-b1d6d1095d5c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.616295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef7711-ddd5-403d-9291-b1d6d1095d5c None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.617679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 476/971] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:05.622937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda76f4-dc6b-428a-9450-43436cdc054a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.623225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda76f4-dc6b-428a-9450-43436cdc054a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.623504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda76f4-dc6b-428a-9450-43436cdc054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.639894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e21052-96e2-44d1-8cd9-fd6863a8c4e5 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.640637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-4bda76f4-dc6b-428a-9450-43436cdc054a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:05.641822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4bda76f4-dc6b-428a-9450-43436cdc054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:05.674964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b1613-4821-4f38-9289-33f97ada7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.675624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1613-4821-4f38-9289-33f97ada7554 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.675908 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1613-4821-4f38-9289-33f97ada7554 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.676240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1613-4821-4f38-9289-33f97ada7554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.677520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b1613-4821-4f38-9289-33f97ada7554 None admin] RBAC: Adding query filter params (interface=admin, service_id=0e7641cff4ce4678b86d4817536906cc, region_id=RegionOne) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:05.677833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b1613-4821-4f38-9289-33f97ada7554 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:05.679428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b1613-4821-4f38-9289-33f97ada7554 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:05.685182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 496/972] 10.222.0.40 () {56 vars in 1249 bytes} [Thu Jun 16 18:38:05 2022] GET /identity/v3/endpoints?service_id=0e7641cff4ce4678b86d4817536906cc&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:05.691567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b1613-4821-4f38-9289-33f97ada7554 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.718707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 477/973] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:05.743755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda76f4-dc6b-428a-9450-43436cdc054a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.817818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b1613-4821-4f38-9289-33f97ada7554 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.848069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:05.854750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcf7f4-fe16-4408-8715-ab3bea5a0211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.855423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcf7f4-fe16-4408-8715-ab3bea5a0211 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.855705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcf7f4-fe16-4408-8715-ab3bea5a0211 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.855979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcf7f4-fe16-4408-8715-ab3bea5a0211 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.856662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcf7f4-fe16-4408-8715-ab3bea5a0211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:05.858008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebcf7f4-fe16-4408-8715-ab3bea5a0211 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:05.859012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda76f4-dc6b-428a-9450-43436cdc054a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:05.864648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 497/974] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jun 16 18:38:05 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:38:05.871711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b474-972d-4d8c-951f-08daf5c8d51b None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.871711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b474-972d-4d8c-951f-08daf5c8d51b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.871711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b474-972d-4d8c-951f-08daf5c8d51b None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.871711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 498/975] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:05.873644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c3c30-349a-4ad7-a863-9dcdddb971d4 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.873933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c3c30-349a-4ad7-a863-9dcdddb971d4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.874210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c3c30-349a-4ad7-a863-9dcdddb971d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.892175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4c2c3c30-349a-4ad7-a863-9dcdddb971d4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:05.893430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4c2c3c30-349a-4ad7-a863-9dcdddb971d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:05.903135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:05.912278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64f011-faf1-4452-9e62-29155ed55a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:05.913175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64f011-faf1-4452-9e62-29155ed55a06 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:05.913455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64f011-faf1-4452-9e62-29155ed55a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:05.913716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64f011-faf1-4452-9e62-29155ed55a06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:05.926416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64f011-faf1-4452-9e62-29155ed55a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-eb64f011-faf1-4452-9e62-29155ed55a06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:05.936041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:05.938652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:05.939705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 478/976] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:05.943624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64f011-faf1-4452-9e62-29155ed55a06 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:05.994515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 499/977] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:06.019101 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c3c30-349a-4ad7-a863-9dcdddb971d4 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:06.078912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64f011-faf1-4452-9e62-29155ed55a06 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:06.118062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342359f-d424-412c-aee4-29db4aa5718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:06.118762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342359f-d424-412c-aee4-29db4aa5718e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:06.119043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342359f-d424-412c-aee4-29db4aa5718e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:06.119315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342359f-d424-412c-aee4-29db4aa5718e None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:06.120058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342359f-d424-412c-aee4-29db4aa5718e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:06.120359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342359f-d424-412c-aee4-29db4aa5718e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:06.121759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342359f-d424-412c-aee4-29db4aa5718e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:06.131189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 479/978] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:06.140432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342359f-d424-412c-aee4-29db4aa5718e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:06.145001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c3c30-349a-4ad7-a863-9dcdddb971d4 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:06.175782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:06.189641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15bf0e-4d7e-402b-83b9-44a06a3c1c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:06.190488 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15bf0e-4d7e-402b-83b9-44a06a3c1c8e None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:06.190896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15bf0e-4d7e-402b-83b9-44a06a3c1c8e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:06.191272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15bf0e-4d7e-402b-83b9-44a06a3c1c8e None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:06.192131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15bf0e-4d7e-402b-83b9-44a06a3c1c8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:06.193593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15bf0e-4d7e-402b-83b9-44a06a3c1c8e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:06.211420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:06.211701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 500/979] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:06 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:06.275043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342359f-d424-412c-aee4-29db4aa5718e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:06.321375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7255f7d-f48e-473a-a20e-94c56451cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:06.322283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7255f7d-f48e-473a-a20e-94c56451cd9f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:06.322657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7255f7d-f48e-473a-a20e-94c56451cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:06.322996 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7255f7d-f48e-473a-a20e-94c56451cd9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:06.335259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7255f7d-f48e-473a-a20e-94c56451cd9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:06.336849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7255f7d-f48e-473a-a20e-94c56451cd9f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-e7255f7d-f48e-473a-a20e-94c56451cd9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:06.355790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:06.359075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:06.359987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:06.359987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:06.359987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:06.359987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:06.359987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 480/980] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:06.363654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15bf0e-4d7e-402b-83b9-44a06a3c1c8e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:06.475896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15bf0e-4d7e-402b-83b9-44a06a3c1c8e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:06.514823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336196af-2728-4c62-aecf-a7ef78eac716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:06.515506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336196af-2728-4c62-aecf-a7ef78eac716 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:06.515794 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336196af-2728-4c62-aecf-a7ef78eac716 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:06.516072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336196af-2728-4c62-aecf-a7ef78eac716 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:06.516832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336196af-2728-4c62-aecf-a7ef78eac716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:06.517142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336196af-2728-4c62-aecf-a7ef78eac716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:06.518601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336196af-2728-4c62-aecf-a7ef78eac716 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:06.532514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 501/981] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:06.538443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7255f7d-f48e-473a-a20e-94c56451cd9f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:06.644427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:06.648704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7255f7d-f48e-473a-a20e-94c56451cd9f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:06.687590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aa86c-ca18-45bb-805f-f899287582fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:06.688822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aa86c-ca18-45bb-805f-f899287582fc None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:06.689202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aa86c-ca18-45bb-805f-f899287582fc None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:06.689593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aa86c-ca18-45bb-805f-f899287582fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:06.699205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aa86c-ca18-45bb-805f-f899287582fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:06.700838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aa86c-ca18-45bb-805f-f899287582fc None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-277aa86c-ca18-45bb-805f-f899287582fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:06.716607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:06.717805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 18:38:06.718969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:06.722340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 481/982] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:38:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:06.726881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336196af-2728-4c62-aecf-a7ef78eac716 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:06.778263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:06.843634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336196af-2728-4c62-aecf-a7ef78eac716 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:06.880021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08622e-167f-45f2-905d-1472aea009b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:06.880864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08622e-167f-45f2-905d-1472aea009b2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:06.881272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08622e-167f-45f2-905d-1472aea009b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:06.881684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08622e-167f-45f2-905d-1472aea009b2 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:06.882685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08622e-167f-45f2-905d-1472aea009b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:06.883107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08622e-167f-45f2-905d-1472aea009b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:06.884661 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08622e-167f-45f2-905d-1472aea009b2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:06.910595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 502/983] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jun 16 18:38:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:06.913019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aa86c-ca18-45bb-805f-f899287582fc None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.030943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aa86c-ca18-45bb-805f-f899287582fc None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.068935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04558f-9913-4ee7-9800-8038cb31ce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.069585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04558f-9913-4ee7-9800-8038cb31ce0a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.069865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04558f-9913-4ee7-9800-8038cb31ce0a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.070137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04558f-9913-4ee7-9800-8038cb31ce0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.104334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:07.149167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04558f-9913-4ee7-9800-8038cb31ce0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.150753 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04558f-9913-4ee7-9800-8038cb31ce0a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.277343 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 482/984] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:06 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:07.284804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08622e-167f-45f2-905d-1472aea009b2 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.397747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08622e-167f-45f2-905d-1472aea009b2 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.401219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:07.445117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714802f4-a01a-436f-94cf-6c246205ab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.445919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714802f4-a01a-436f-94cf-6c246205ab6a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.446194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714802f4-a01a-436f-94cf-6c246205ab6a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.446616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714802f4-a01a-436f-94cf-6c246205ab6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.458103 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714802f4-a01a-436f-94cf-6c246205ab6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.459573 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714802f4-a01a-436f-94cf-6c246205ab6a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-714802f4-a01a-436f-94cf-6c246205ab6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:07.478632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:07.479642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:07.480533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:07.480533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:07.480533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:07.480533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:07.485157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 503/985] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:07.485484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04558f-9913-4ee7-9800-8038cb31ce0a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.560932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:07.603689 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04558f-9913-4ee7-9800-8038cb31ce0a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.640058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc989-6f93-4755-8ea4-a6c4eee50d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.640713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc989-6f93-4755-8ea4-a6c4eee50d0d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.640992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc989-6f93-4755-8ea4-a6c4eee50d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.641265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc989-6f93-4755-8ea4-a6c4eee50d0d None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.641973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc989-6f93-4755-8ea4-a6c4eee50d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:07.642272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc989-6f93-4755-8ea4-a6c4eee50d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.643660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc989-6f93-4755-8ea4-a6c4eee50d0d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.655592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 483/986] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:07.660827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714802f4-a01a-436f-94cf-6c246205ab6a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.759471 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714802f4-a01a-436f-94cf-6c246205ab6a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.793059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a50e68-1c3e-4035-a538-1eb6ec9a4983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.793844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a50e68-1c3e-4035-a538-1eb6ec9a4983 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.794123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a50e68-1c3e-4035-a538-1eb6ec9a4983 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.794406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a50e68-1c3e-4035-a538-1eb6ec9a4983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.801380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a50e68-1c3e-4035-a538-1eb6ec9a4983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.803004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a50e68-1c3e-4035-a538-1eb6ec9a4983 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-39a50e68-1c3e-4035-a538-1eb6ec9a4983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:07.817289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:07.818196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:07.819143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:07.819143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:07.819143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:07.819143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:07.819143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:07.819143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:07.819143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:07.819143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:07.822698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 504/987] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:07.824357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc989-6f93-4755-8ea4-a6c4eee50d0d None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:07.926779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc989-6f93-4755-8ea4-a6c4eee50d0d None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:07.946601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:07.962227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5745718-d457-4612-8ff1-7769765ec102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:07.962921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5745718-d457-4612-8ff1-7769765ec102 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:07.963200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5745718-d457-4612-8ff1-7769765ec102 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:07.963474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5745718-d457-4612-8ff1-7769765ec102 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:07.964263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5745718-d457-4612-8ff1-7769765ec102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:07.964569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5745718-d457-4612-8ff1-7769765ec102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:07.966054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5745718-d457-4612-8ff1-7769765ec102 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:07.980764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 484/988] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:07.986737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a50e68-1c3e-4035-a538-1eb6ec9a4983 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.004087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.047731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c2b8-f079-4caa-8dd3-43aa0d158341 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.048027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c2b8-f079-4caa-8dd3-43aa0d158341 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.048301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c2b8-f079-4caa-8dd3-43aa0d158341 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.049799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 485/989] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:08.054587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932679d7-4f2f-4435-b259-0ddad9ef4b2c None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.054874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932679d7-4f2f-4435-b259-0ddad9ef4b2c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.055152 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932679d7-4f2f-4435-b259-0ddad9ef4b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.072479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-932679d7-4f2f-4435-b259-0ddad9ef4b2c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:08.073667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-932679d7-4f2f-4435-b259-0ddad9ef4b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:08.095844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a50e68-1c3e-4035-a538-1eb6ec9a4983 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.132499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b666c2-468e-4b96-8fd7-efe9969889c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.133154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b666c2-468e-4b96-8fd7-efe9969889c7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.133445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b666c2-468e-4b96-8fd7-efe9969889c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.133709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b666c2-468e-4b96-8fd7-efe9969889c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.134611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b666c2-468e-4b96-8fd7-efe9969889c7 None admin] RBAC: Adding query filter params (role.id=08ce118e12014a0dba5eda04a1cd8232, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6e8f3976dd524feeb4277e4ba4c8090b) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:08.134875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b666c2-468e-4b96-8fd7-efe9969889c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.136300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b666c2-468e-4b96-8fd7-efe9969889c7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.142327 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 505/990] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:07 2022] GET /identity/v3/role_assignments?user.id=6e8f3976dd524feeb4277e4ba4c8090b&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=08ce118e12014a0dba5eda04a1cd8232 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:08.145816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 486/991] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:08.168913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b666c2-468e-4b96-8fd7-efe9969889c7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.264555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.289381 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b666c2-468e-4b96-8fd7-efe9969889c7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.328210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf49dd-814a-4604-ba42-48742689e31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.329024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf49dd-814a-4604-ba42-48742689e31d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.329308 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf49dd-814a-4604-ba42-48742689e31d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.329582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf49dd-814a-4604-ba42-48742689e31d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.330233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf49dd-814a-4604-ba42-48742689e31d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.331636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf49dd-814a-4604-ba42-48742689e31d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-62bf49dd-814a-4604-ba42-48742689e31d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:08.344725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:08.345760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 18:38:08.346652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:08.351063 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 506/992] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:08.352101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932679d7-4f2f-4435-b259-0ddad9ef4b2c None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.445992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03190b6d-d766-473a-bd50-89af4501b4f0 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.446284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03190b6d-d766-473a-bd50-89af4501b4f0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.446600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03190b6d-d766-473a-bd50-89af4501b4f0 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.448108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 507/993] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:08.453055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072504c9-de5b-47af-b6eb-2a4f5f994bed None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.453345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072504c9-de5b-47af-b6eb-2a4f5f994bed None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.453629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072504c9-de5b-47af-b6eb-2a4f5f994bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.468360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932679d7-4f2f-4435-b259-0ddad9ef4b2c None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.470329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-072504c9-de5b-47af-b6eb-2a4f5f994bed None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:08.471558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-072504c9-de5b-47af-b6eb-2a4f5f994bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:08.479750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.515730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafdc96-915f-45b4-88c0-1d5a330a3fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.516342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafdc96-915f-45b4-88c0-1d5a330a3fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.516622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafdc96-915f-45b4-88c0-1d5a330a3fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.516898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafdc96-915f-45b4-88c0-1d5a330a3fc3 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.517607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafdc96-915f-45b4-88c0-1d5a330a3fc3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:08.517913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafdc96-915f-45b4-88c0-1d5a330a3fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.519324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafdc96-915f-45b4-88c0-1d5a330a3fc3 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.528977 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 487/994] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:08.530047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafdc96-915f-45b4-88c0-1d5a330a3fc3 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.552131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 508/995] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:08.575756 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072504c9-de5b-47af-b6eb-2a4f5f994bed None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.643172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafdc96-915f-45b4-88c0-1d5a330a3fc3 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.646955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.681183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072504c9-de5b-47af-b6eb-2a4f5f994bed None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.686608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523af05-630d-46a0-9329-842ddcd4ca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.687284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523af05-630d-46a0-9329-842ddcd4ca70 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.687571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523af05-630d-46a0-9329-842ddcd4ca70 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.687847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523af05-630d-46a0-9329-842ddcd4ca70 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.688820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523af05-630d-46a0-9329-842ddcd4ca70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:08.689130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523af05-630d-46a0-9329-842ddcd4ca70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.690527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523af05-630d-46a0-9329-842ddcd4ca70 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.700689 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 488/996] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:08.701745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523af05-630d-46a0-9329-842ddcd4ca70 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.724102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc97572-834e-4563-aeaa-66926fef81d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.724905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc97572-834e-4563-aeaa-66926fef81d2 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.725190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc97572-834e-4563-aeaa-66926fef81d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.725476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc97572-834e-4563-aeaa-66926fef81d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.726131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc97572-834e-4563-aeaa-66926fef81d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.727529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc97572-834e-4563-aeaa-66926fef81d2 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-2fc97572-834e-4563-aeaa-66926fef81d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:08.740065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:08.741111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:08.742354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 509/997] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:08.747011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc97572-834e-4563-aeaa-66926fef81d2 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:08.748415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.817576 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523af05-630d-46a0-9329-842ddcd4ca70 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.856760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd198d4-3fd4-4c0a-bcc4-6c9d359e4fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.857481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd198d4-3fd4-4c0a-bcc4-6c9d359e4fbb None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.857766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd198d4-3fd4-4c0a-bcc4-6c9d359e4fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.858043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd198d4-3fd4-4c0a-bcc4-6c9d359e4fbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.858843 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd198d4-3fd4-4c0a-bcc4-6c9d359e4fbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.860260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd198d4-3fd4-4c0a-bcc4-6c9d359e4fbb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.869728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc97572-834e-4563-aeaa-66926fef81d2 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:08.890435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 489/998] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:08.912291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:08.918303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e5dc9-c89a-4ef7-9d9c-bf74d7b0225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:08.919014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e5dc9-c89a-4ef7-9d9c-bf74d7b0225a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:08.919296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e5dc9-c89a-4ef7-9d9c-bf74d7b0225a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:08.919569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e5dc9-c89a-4ef7-9d9c-bf74d7b0225a None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:08.920287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e5dc9-c89a-4ef7-9d9c-bf74d7b0225a None admin] RBAC: Adding query filter params (name=compute) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:08.920594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e5dc9-c89a-4ef7-9d9c-bf74d7b0225a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:08.921988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e5dc9-c89a-4ef7-9d9c-bf74d7b0225a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:08.928407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 510/999] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:08.934200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd198d4-3fd4-4c0a-bcc4-6c9d359e4fbb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:09.054040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:09.060791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd198d4-3fd4-4c0a-bcc4-6c9d359e4fbb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:09.099424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249ae6a-8964-49d0-8c6c-5a465726a2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:09.100015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249ae6a-8964-49d0-8c6c-5a465726a2eb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:09.100294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249ae6a-8964-49d0-8c6c-5a465726a2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:09.100568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249ae6a-8964-49d0-8c6c-5a465726a2eb None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:09.101274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249ae6a-8964-49d0-8c6c-5a465726a2eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:09.101575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249ae6a-8964-49d0-8c6c-5a465726a2eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:09.103208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249ae6a-8964-49d0-8c6c-5a465726a2eb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:09.109612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 490/1000] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:09.116020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e5dc9-c89a-4ef7-9d9c-bf74d7b0225a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:09.225641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e5dc9-c89a-4ef7-9d9c-bf74d7b0225a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:09.260360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c9b98-aa91-4699-838c-82a9a53a754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:09.261016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9b98-aa91-4699-838c-82a9a53a754e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:09.261294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9b98-aa91-4699-838c-82a9a53a754e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:09.261566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9b98-aa91-4699-838c-82a9a53a754e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:09.262350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c9b98-aa91-4699-838c-82a9a53a754e None admin] RBAC: Adding query filter params (interface=public, service_id=ec876cd37a6e47d19d8ceaafe341ddb7, region_id=RegionOne) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:09.262694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c9b98-aa91-4699-838c-82a9a53a754e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:09.264050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c9b98-aa91-4699-838c-82a9a53a754e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:09.269628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 511/1001] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jun 16 18:38:09 2022] GET /identity/v3/endpoints?service_id=ec876cd37a6e47d19d8ceaafe341ddb7&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:09.275542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249ae6a-8964-49d0-8c6c-5a465726a2eb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:09.390424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249ae6a-8964-49d0-8c6c-5a465726a2eb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:09.432041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf139-cf82-4def-9e06-5f5a5b740ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:09.433131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf139-cf82-4def-9e06-5f5a5b740ffb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:09.433618 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf139-cf82-4def-9e06-5f5a5b740ffb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:09.434095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf139-cf82-4def-9e06-5f5a5b740ffb None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:09.435031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bf139-cf82-4def-9e06-5f5a5b740ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:09.436628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bf139-cf82-4def-9e06-5f5a5b740ffb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:09.444928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 491/1002] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jun 16 18:38:09 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:38:10.342414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2f5b-ef29-406f-ad26-4027b3750b45 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.342939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2f5b-ef29-406f-ad26-4027b3750b45 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.342939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2f5b-ef29-406f-ad26-4027b3750b45 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.344358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 512/1003] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:10.349571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215bdbe-cf1e-45be-b26a-76e0fbdf2e22 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.350004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215bdbe-cf1e-45be-b26a-76e0fbdf2e22 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.350168 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215bdbe-cf1e-45be-b26a-76e0fbdf2e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.367071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e215bdbe-cf1e-45be-b26a-76e0fbdf2e22 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:10.368298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e215bdbe-cf1e-45be-b26a-76e0fbdf2e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:10.391823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:10.442679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 492/1004] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:10.466986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c2f5b-ef29-406f-ad26-4027b3750b45 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:10.537997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:10.584739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c2f5b-ef29-406f-ad26-4027b3750b45 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:10.620099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a783c-d5c6-45f8-9a71-6c96c521798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:10.620811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a783c-d5c6-45f8-9a71-6c96c521798f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.621092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a783c-d5c6-45f8-9a71-6c96c521798f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.621363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a783c-d5c6-45f8-9a71-6c96c521798f None admin] PATH_INFO: `/v3/services/image` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.622010 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a783c-d5c6-45f8-9a71-6c96c521798f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:10.623402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a783c-d5c6-45f8-9a71-6c96c521798f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-210a783c-d5c6-45f8-9a71-6c96c521798f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:10.636581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:10.637669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:10.638581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 513/1005] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jun 16 18:38:10 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:10.643914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215bdbe-cf1e-45be-b26a-76e0fbdf2e22 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:10.744553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215bdbe-cf1e-45be-b26a-76e0fbdf2e22 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:10.778652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66a0a9-e67f-4fe1-8952-a5c52d15ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:10.779318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a0a9-e67f-4fe1-8952-a5c52d15ad47 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.779596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a0a9-e67f-4fe1-8952-a5c52d15ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.779867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a0a9-e67f-4fe1-8952-a5c52d15ad47 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.780565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a0a9-e67f-4fe1-8952-a5c52d15ad47 None admin] RBAC: Adding query filter params (name=image) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:10.780865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a0a9-e67f-4fe1-8952-a5c52d15ad47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:10.782223 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a0a9-e67f-4fe1-8952-a5c52d15ad47 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:10.787435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 493/1006] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:10.792936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a783c-d5c6-45f8-9a71-6c96c521798f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:10.894320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a783c-d5c6-45f8-9a71-6c96c521798f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:10.917243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:10.929385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bf0fb-ecc8-4400-9f2d-6e5e87e373f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:10.930058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bf0fb-ecc8-4400-9f2d-6e5e87e373f5 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:10.930338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bf0fb-ecc8-4400-9f2d-6e5e87e373f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:10.930646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bf0fb-ecc8-4400-9f2d-6e5e87e373f5 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:10.931367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bf0fb-ecc8-4400-9f2d-6e5e87e373f5 None admin] RBAC: Adding query filter params (type=image) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:10.931672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bf0fb-ecc8-4400-9f2d-6e5e87e373f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:10.933054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bf0fb-ecc8-4400-9f2d-6e5e87e373f5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:10.938607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 514/1007] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:11.083598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732897-eaac-4e98-a021-517839ab4c3f None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.083971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732897-eaac-4e98-a021-517839ab4c3f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.084156 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732897-eaac-4e98-a021-517839ab4c3f None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.085749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 494/1008] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:11.091302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68052e9f-79db-4697-a50c-856fbc6472fa None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.091595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68052e9f-79db-4697-a50c-856fbc6472fa None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.091876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68052e9f-79db-4697-a50c-856fbc6472fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.110259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-68052e9f-79db-4697-a50c-856fbc6472fa None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:11.111727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-68052e9f-79db-4697-a50c-856fbc6472fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:11.182550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 515/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:11.205371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e732897-eaac-4e98-a021-517839ab4c3f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:11.228174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:11.313223 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e732897-eaac-4e98-a021-517839ab4c3f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:11.349406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fd2d-bdf5-4c64-80af-bbb878d407ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:11.350202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fd2d-bdf5-4c64-80af-bbb878d407ef None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.350795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fd2d-bdf5-4c64-80af-bbb878d407ef None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.350795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fd2d-bdf5-4c64-80af-bbb878d407ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.352071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fd2d-bdf5-4c64-80af-bbb878d407ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:11.353547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fd2d-bdf5-4c64-80af-bbb878d407ef None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:11.355380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 495/1010] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:11.360901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68052e9f-79db-4697-a50c-856fbc6472fa None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:11.464036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68052e9f-79db-4697-a50c-856fbc6472fa None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:11.482063 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:11.510263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7f2e5-5537-4175-a46b-f05920e37662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:11.510971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f2e5-5537-4175-a46b-f05920e37662 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.511261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f2e5-5537-4175-a46b-f05920e37662 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.511538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f2e5-5537-4175-a46b-f05920e37662 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.512266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7f2e5-5537-4175-a46b-f05920e37662 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:11.513690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7f2e5-5537-4175-a46b-f05920e37662 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:11.543956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 516/1011] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:11 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:11.620301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ef23f-ad10-41c0-93bf-97dcae6dfe84 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.620662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ef23f-ad10-41c0-93bf-97dcae6dfe84 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.620853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ef23f-ad10-41c0-93bf-97dcae6dfe84 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.622455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 496/1012] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:11.628049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f139a0-2d1c-4e8a-86d1-f590123cdb75 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.628339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f139a0-2d1c-4e8a-86d1-f590123cdb75 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.628614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f139a0-2d1c-4e8a-86d1-f590123cdb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.647685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-94f139a0-2d1c-4e8a-86d1-f590123cdb75 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:11.648935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-94f139a0-2d1c-4e8a-86d1-f590123cdb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:11.728067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 517/1013] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:11.751318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ef23f-ad10-41c0-93bf-97dcae6dfe84 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:11.843737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:11.858485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ef23f-ad10-41c0-93bf-97dcae6dfe84 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:11.894831 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae657-976a-4777-b698-9c62070909ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:11.895660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae657-976a-4777-b698-9c62070909ec None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:11.895938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae657-976a-4777-b698-9c62070909ec None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:11.896212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae657-976a-4777-b698-9c62070909ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:11.896862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ae657-976a-4777-b698-9c62070909ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:11.898226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ae657-976a-4777-b698-9c62070909ec None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-d01ae657-976a-4777-b698-9c62070909ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:11.909896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:11.910882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:11.912288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 497/1014] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:11.917452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f139a0-2d1c-4e8a-86d1-f590123cdb75 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.019618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:12.023426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f139a0-2d1c-4e8a-86d1-f590123cdb75 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.063596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68248f-f456-4aa7-a57d-0ed29af24cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.064268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68248f-f456-4aa7-a57d-0ed29af24cef None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.064550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68248f-f456-4aa7-a57d-0ed29af24cef None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.064826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68248f-f456-4aa7-a57d-0ed29af24cef None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.065604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68248f-f456-4aa7-a57d-0ed29af24cef None admin] RBAC: Adding query filter params (name=compute) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:12.065917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68248f-f456-4aa7-a57d-0ed29af24cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:12.067404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68248f-f456-4aa7-a57d-0ed29af24cef None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:12.072688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 518/1015] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:12.078128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae657-976a-4777-b698-9c62070909ec None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.181340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae657-976a-4777-b698-9c62070909ec None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.215346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b94c8-b501-4771-a89f-09616d92b741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.216011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b94c8-b501-4771-a89f-09616d92b741 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.216293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b94c8-b501-4771-a89f-09616d92b741 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.216567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b94c8-b501-4771-a89f-09616d92b741 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.217265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b94c8-b501-4771-a89f-09616d92b741 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:12.217568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b94c8-b501-4771-a89f-09616d92b741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:12.218967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b94c8-b501-4771-a89f-09616d92b741 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:12.224526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 498/1016] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jun 16 18:38:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:12.230040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68248f-f456-4aa7-a57d-0ed29af24cef None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:12.330189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68248f-f456-4aa7-a57d-0ed29af24cef None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:12.365089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6fa47-a56b-4c2c-89c2-14b985c6688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:12.365812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6fa47-a56b-4c2c-89c2-14b985c6688a None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:12.366074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6fa47-a56b-4c2c-89c2-14b985c6688a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:12.366354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6fa47-a56b-4c2c-89c2-14b985c6688a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:12.367175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6fa47-a56b-4c2c-89c2-14b985c6688a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:12.368521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6fa47-a56b-4c2c-89c2-14b985c6688a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:12.394406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 519/1017] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:13.098196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af63a-1850-4fad-90c8-66307921c086 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.099318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af63a-1850-4fad-90c8-66307921c086 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.099396 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af63a-1850-4fad-90c8-66307921c086 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.100759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 499/1018] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:13.106099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2b228-01f1-410d-a184-a1d7e99efd17 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.106470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2b228-01f1-410d-a184-a1d7e99efd17 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.106802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2b228-01f1-410d-a184-a1d7e99efd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.124783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-84f2b228-01f1-410d-a184-a1d7e99efd17 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:13.125984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-84f2b228-01f1-410d-a184-a1d7e99efd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:13.140928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:13.203605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 520/1019] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:13 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:13.227195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6af63a-1850-4fad-90c8-66307921c086 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.246078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:13.332466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6af63a-1850-4fad-90c8-66307921c086 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:13.367447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aad74e-b590-40d4-835e-bd037740a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:13.368059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad74e-b590-40d4-835e-bd037740a66b None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.368348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad74e-b590-40d4-835e-bd037740a66b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.368623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad74e-b590-40d4-835e-bd037740a66b None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.369354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aad74e-b590-40d4-835e-bd037740a66b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:13.370765 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aad74e-b590-40d4-835e-bd037740a66b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:13.394419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 500/1020] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:13 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:13.747230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e0d73-97eb-4ab2-aca0-efa02873d17d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.747800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e0d73-97eb-4ab2-aca0-efa02873d17d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.747800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e0d73-97eb-4ab2-aca0-efa02873d17d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.749177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 521/1021] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:13.754533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e678-4ba0-4c14-818f-fdad486934db None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:13.755446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e678-4ba0-4c14-818f-fdad486934db None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:13.755807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e678-4ba0-4c14-818f-fdad486934db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:13.772676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-cb92e678-4ba0-4c14-818f-fdad486934db None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:13.773852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-cb92e678-4ba0-4c14-818f-fdad486934db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:13.849441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 501/1022] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:13.874145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e0d73-97eb-4ab2-aca0-efa02873d17d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:13.976322 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e0d73-97eb-4ab2-aca0-efa02873d17d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.011421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfcf3d-f47b-4763-8d7d-9d5fbb851fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.012146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfcf3d-f47b-4763-8d7d-9d5fbb851fa1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.012425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfcf3d-f47b-4763-8d7d-9d5fbb851fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.012698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfcf3d-f47b-4763-8d7d-9d5fbb851fa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.013862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfcf3d-f47b-4763-8d7d-9d5fbb851fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.015342 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfcf3d-f47b-4763-8d7d-9d5fbb851fa1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:14.021449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 522/1023] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:14.022585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92e678-4ba0-4c14-818f-fdad486934db None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:14.024755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.134427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92e678-4ba0-4c14-818f-fdad486934db None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.169903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae43fa0-30ab-494b-a89d-2983f2c398ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.170769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43fa0-30ab-494b-a89d-2983f2c398ab None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.171050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43fa0-30ab-494b-a89d-2983f2c398ab None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.171697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae43fa0-30ab-494b-a89d-2983f2c398ab None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.172418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae43fa0-30ab-494b-a89d-2983f2c398ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:14.173854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae43fa0-30ab-494b-a89d-2983f2c398ab None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:14.202420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 502/1024] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:38:14 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:14.639686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd9227-2ee7-4a39-802e-c34d76a25583 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.639963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd9227-2ee7-4a39-802e-c34d76a25583 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.640447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd9227-2ee7-4a39-802e-c34d76a25583 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.641862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 523/1025] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:14.647477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b372a-2acc-49c3-90cc-8be3ae7995ec None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.647773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b372a-2acc-49c3-90cc-8be3ae7995ec None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.648052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b372a-2acc-49c3-90cc-8be3ae7995ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.665300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-cd9b372a-2acc-49c3-90cc-8be3ae7995ec None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:14.666501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-cd9b372a-2acc-49c3-90cc-8be3ae7995ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:14.721205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.739159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 503/1026] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:14.762432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd9227-2ee7-4a39-802e-c34d76a25583 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:14.779961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:14.867544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd9227-2ee7-4a39-802e-c34d76a25583 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:14.902348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d7694-169c-4f8b-aef4-cef7f3a59c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:14.903187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7694-169c-4f8b-aef4-cef7f3a59c01 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:14.903473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7694-169c-4f8b-aef4-cef7f3a59c01 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:14.903747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7694-169c-4f8b-aef4-cef7f3a59c01 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:14.914458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d7694-169c-4f8b-aef4-cef7f3a59c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-b39d7694-169c-4f8b-aef4-cef7f3a59c01 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:14.922739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:14.923665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:14.929687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 524/1027] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:14.930692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b372a-2acc-49c3-90cc-8be3ae7995ec None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.031267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b372a-2acc-49c3-90cc-8be3ae7995ec None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.064921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb5cbb-76d6-47f3-8c07-1b76ecc09035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.065583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb5cbb-76d6-47f3-8c07-1b76ecc09035 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.065863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb5cbb-76d6-47f3-8c07-1b76ecc09035 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.066137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb5cbb-76d6-47f3-8c07-1b76ecc09035 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.066904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb5cbb-76d6-47f3-8c07-1b76ecc09035 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:15.067724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb5cbb-76d6-47f3-8c07-1b76ecc09035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:15.069101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb5cbb-76d6-47f3-8c07-1b76ecc09035 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:15.077285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 504/1028] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:15.082748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d7694-169c-4f8b-aef4-cef7f3a59c01 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.162857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:15.191114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d7694-169c-4f8b-aef4-cef7f3a59c01 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.224654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067a93c-ddd0-4318-b393-b3fe5a12f6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.225444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067a93c-ddd0-4318-b393-b3fe5a12f6a0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.225728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067a93c-ddd0-4318-b393-b3fe5a12f6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.226005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067a93c-ddd0-4318-b393-b3fe5a12f6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.236612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067a93c-ddd0-4318-b393-b3fe5a12f6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:15.238048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067a93c-ddd0-4318-b393-b3fe5a12f6a0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-9067a93c-ddd0-4318-b393-b3fe5a12f6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:15.256232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:15.257170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:15.262912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:15.262912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:15.262912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:15.262912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:15.262912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 525/1029] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:15.264574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb5cbb-76d6-47f3-8c07-1b76ecc09035 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.317992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:15.371275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb5cbb-76d6-47f3-8c07-1b76ecc09035 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.405211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c317c7-0ccd-4e42-8a2e-3f050536e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.405881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c317c7-0ccd-4e42-8a2e-3f050536e60b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.406174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c317c7-0ccd-4e42-8a2e-3f050536e60b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.406489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c317c7-0ccd-4e42-8a2e-3f050536e60b None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.407224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c317c7-0ccd-4e42-8a2e-3f050536e60b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:15.407536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c317c7-0ccd-4e42-8a2e-3f050536e60b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:15.408945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c317c7-0ccd-4e42-8a2e-3f050536e60b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:15.421249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 505/1030] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:15.427318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067a93c-ddd0-4318-b393-b3fe5a12f6a0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.538345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9efb65-9c6c-48c2-a877-886d3591d372 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.538676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9efb65-9c6c-48c2-a877-886d3591d372 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.538940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9efb65-9c6c-48c2-a877-886d3591d372 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.540569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 506/1031] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:15.545188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b21518-c3ff-4309-b1e6-e99677cefd92 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.545546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b21518-c3ff-4309-b1e6-e99677cefd92 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.545895 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b21518-c3ff-4309-b1e6-e99677cefd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.548183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067a93c-ddd0-4318-b393-b3fe5a12f6a0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.564562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-32b21518-c3ff-4309-b1e6-e99677cefd92 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:15.565736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-32b21518-c3ff-4309-b1e6-e99677cefd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:15.577783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:15.588897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1903b96-0d86-4dcf-a78e-33839a2d1379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.589731 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1903b96-0d86-4dcf-a78e-33839a2d1379 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.589964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1903b96-0d86-4dcf-a78e-33839a2d1379 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.590236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1903b96-0d86-4dcf-a78e-33839a2d1379 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.598407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1903b96-0d86-4dcf-a78e-33839a2d1379 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:15.600369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1903b96-0d86-4dcf-a78e-33839a2d1379 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-c1903b96-0d86-4dcf-a78e-33839a2d1379 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:15.615206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:15.616192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:15.617130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 526/1032] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jun 16 18:38:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:15.622129 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1903b96-0d86-4dcf-a78e-33839a2d1379 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.643242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 507/1033] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:15.666052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b21518-c3ff-4309-b1e6-e99677cefd92 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.710495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:15.731439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1903b96-0d86-4dcf-a78e-33839a2d1379 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.767523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d128aea-7ac2-4dec-a242-6f18885d0fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.768188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d128aea-7ac2-4dec-a242-6f18885d0fa7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.768453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d128aea-7ac2-4dec-a242-6f18885d0fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.768721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d128aea-7ac2-4dec-a242-6f18885d0fa7 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.769553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d128aea-7ac2-4dec-a242-6f18885d0fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:15.769857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d128aea-7ac2-4dec-a242-6f18885d0fa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:15.771350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d128aea-7ac2-4dec-a242-6f18885d0fa7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:15.775678 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b21518-c3ff-4309-b1e6-e99677cefd92 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.790047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 527/1034] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jun 16 18:38:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:15.795819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d128aea-7ac2-4dec-a242-6f18885d0fa7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.812885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3dd03-4283-4bc6-bef3-25451fa68c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.813938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3dd03-4283-4bc6-bef3-25451fa68c75 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.814216 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3dd03-4283-4bc6-bef3-25451fa68c75 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.814527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3dd03-4283-4bc6-bef3-25451fa68c75 None admin] PATH_INFO: `/v3/services/image` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.815177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3dd03-4283-4bc6-bef3-25451fa68c75 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:15.816560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3dd03-4283-4bc6-bef3-25451fa68c75 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-04e3dd03-4283-4bc6-bef3-25451fa68c75 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:15.828595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:15.829775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:15.830804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:15.836344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 508/1035] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jun 16 18:38:15 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:15.837724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3dd03-4283-4bc6-bef3-25451fa68c75 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:15.860188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:15.924097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d128aea-7ac2-4dec-a242-6f18885d0fa7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.950543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3dd03-4283-4bc6-bef3-25451fa68c75 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:15.952892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:15.974451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb9bd-a71a-4c82-9b2a-9c1cfe3a786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.975111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb9bd-a71a-4c82-9b2a-9c1cfe3a786a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.975402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb9bd-a71a-4c82-9b2a-9c1cfe3a786a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.975676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb9bd-a71a-4c82-9b2a-9c1cfe3a786a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.990279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c2175-2556-4575-a3a4-67c5cd608b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:15.990975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c2175-2556-4575-a3a4-67c5cd608b29 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:15.991260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c2175-2556-4575-a3a4-67c5cd608b29 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:15.991535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c2175-2556-4575-a3a4-67c5cd608b29 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:15.992278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c2175-2556-4575-a3a4-67c5cd608b29 None admin] RBAC: Adding query filter params (name=image) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:15.992549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c2175-2556-4575-a3a4-67c5cd608b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:15.993942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c2175-2556-4575-a3a4-67c5cd608b29 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.003734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 509/1036] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:16.004820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c2175-2556-4575-a3a4-67c5cd608b29 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.055622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeb9bd-a71a-4c82-9b2a-9c1cfe3a786a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.057067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeb9bd-a71a-4c82-9b2a-9c1cfe3a786a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.102692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:16.119550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c2175-2556-4575-a3a4-67c5cd608b29 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.155888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14131ff1-d22f-410d-aee8-59c6511ce427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.156553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14131ff1-d22f-410d-aee8-59c6511ce427 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.156837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14131ff1-d22f-410d-aee8-59c6511ce427 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.157116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14131ff1-d22f-410d-aee8-59c6511ce427 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.157820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14131ff1-d22f-410d-aee8-59c6511ce427 None admin] RBAC: Adding query filter params (type=image) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:16.158125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14131ff1-d22f-410d-aee8-59c6511ce427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.159527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14131ff1-d22f-410d-aee8-59c6511ce427 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.164965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 510/1037] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:16.166186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 528/1038] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 18:38:16.170822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14131ff1-d22f-410d-aee8-59c6511ce427 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.171794 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb9bd-a71a-4c82-9b2a-9c1cfe3a786a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.204345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:16.275210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14131ff1-d22f-410d-aee8-59c6511ce427 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.281596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb9bd-a71a-4c82-9b2a-9c1cfe3a786a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.311860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce26d60-7fa1-4f7c-b550-da3548cd7cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.312517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce26d60-7fa1-4f7c-b550-da3548cd7cb7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.312800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce26d60-7fa1-4f7c-b550-da3548cd7cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.313075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce26d60-7fa1-4f7c-b550-da3548cd7cb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.314138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce26d60-7fa1-4f7c-b550-da3548cd7cb7 None admin] RBAC: Adding query filter params (interface=public, service_id=7a1f0e2e558f44b6be06af1dffd6ea94, region_id=RegionOne) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:16.314475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce26d60-7fa1-4f7c-b550-da3548cd7cb7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.315843 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce26d60-7fa1-4f7c-b550-da3548cd7cb7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.319550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76647e8b-4343-4d6d-ba4b-34de6a6761ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.320541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76647e8b-4343-4d6d-ba4b-34de6a6761ef None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.320996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76647e8b-4343-4d6d-ba4b-34de6a6761ef None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.321102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 511/1039] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/endpoints?service_id=7a1f0e2e558f44b6be06af1dffd6ea94&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:16.321633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76647e8b-4343-4d6d-ba4b-34de6a6761ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.326612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce26d60-7fa1-4f7c-b550-da3548cd7cb7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.332957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76647e8b-4343-4d6d-ba4b-34de6a6761ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.334684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76647e8b-4343-4d6d-ba4b-34de6a6761ef None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.338031 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-76647e8b-4343-4d6d-ba4b-34de6a6761ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:16.357251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:16.358294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:16.359433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:16.359433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:16.359433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:16.359433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:16.359433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 529/1040] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:16.365668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76647e8b-4343-4d6d-ba4b-34de6a6761ef None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.434851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:16.441531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce26d60-7fa1-4f7c-b550-da3548cd7cb7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.471093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76647e8b-4343-4d6d-ba4b-34de6a6761ef None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.475310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff6c3-6064-4cc2-90d2-6323e315986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.475976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff6c3-6064-4cc2-90d2-6323e315986d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.476262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff6c3-6064-4cc2-90d2-6323e315986d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.476540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff6c3-6064-4cc2-90d2-6323e315986d None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.477220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeff6c3-6064-4cc2-90d2-6323e315986d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.478630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeff6c3-6064-4cc2-90d2-6323e315986d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.485283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 512/1041] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:38:16.486528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f0ad-a777-4d3d-b023-fbfd0e42f266 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.486813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f0ad-a777-4d3d-b023-fbfd0e42f266 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.487095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f0ad-a777-4d3d-b023-fbfd0e42f266 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.488336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 513/1042] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:16.495310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b430ec9-cfcd-4d01-aab1-2189ebb6ed64 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.495647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b430ec9-cfcd-4d01-aab1-2189ebb6ed64 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.495878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b430ec9-cfcd-4d01-aab1-2189ebb6ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.510931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897738d-f4d6-487e-a4fa-5fa0e4ae9b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.511740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897738d-f4d6-487e-a4fa-5fa0e4ae9b86 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.512032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897738d-f4d6-487e-a4fa-5fa0e4ae9b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.512313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897738d-f4d6-487e-a4fa-5fa0e4ae9b86 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.513062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897738d-f4d6-487e-a4fa-5fa0e4ae9b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:16.513377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897738d-f4d6-487e-a4fa-5fa0e4ae9b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.514837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897738d-f4d6-487e-a4fa-5fa0e4ae9b86 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.517980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-5b430ec9-cfcd-4d01-aab1-2189ebb6ed64 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:16.519252 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5b430ec9-cfcd-4d01-aab1-2189ebb6ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:16.531980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 530/1043] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:16.533152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897738d-f4d6-487e-a4fa-5fa0e4ae9b86 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.599305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:16.605468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 514/1044] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:16.629126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b430ec9-cfcd-4d01-aab1-2189ebb6ed64 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.651239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897738d-f4d6-487e-a4fa-5fa0e4ae9b86 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.685685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c7279-465b-469b-a45e-8fce2154ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.686579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c7279-465b-469b-a45e-8fce2154ecf8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.686870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c7279-465b-469b-a45e-8fce2154ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.687151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c7279-465b-469b-a45e-8fce2154ecf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.695126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c7279-465b-469b-a45e-8fce2154ecf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.697064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c7279-465b-469b-a45e-8fce2154ecf8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-033c7279-465b-469b-a45e-8fce2154ecf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:16.712897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:16.713871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:16.714876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:16.714876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:16.714876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:16.714876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:16.714876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:16.714876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:16.714876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:16.714876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:16.714876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 531/1045] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:16.719746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c7279-465b-469b-a45e-8fce2154ecf8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.737363 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:16.748381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b430ec9-cfcd-4d01-aab1-2189ebb6ed64 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.783448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8d44-22b5-46b5-9f4b-056b3e435113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.784248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8d44-22b5-46b5-9f4b-056b3e435113 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.784533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8d44-22b5-46b5-9f4b-056b3e435113 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.784814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8d44-22b5-46b5-9f4b-056b3e435113 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.795786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca8d44-22b5-46b5-9f4b-056b3e435113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-1bca8d44-22b5-46b5-9f4b-056b3e435113 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:16.804418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:16.805381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:16.806229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 515/1046] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:16.811521 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8d44-22b5-46b5-9f4b-056b3e435113 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.848363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c7279-465b-469b-a45e-8fce2154ecf8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.867108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:16.887688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c85f7-35fc-49fb-9d48-eee77dd986a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.888426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c85f7-35fc-49fb-9d48-eee77dd986a8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.888711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c85f7-35fc-49fb-9d48-eee77dd986a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.888991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c85f7-35fc-49fb-9d48-eee77dd986a8 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.889780 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c85f7-35fc-49fb-9d48-eee77dd986a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:16.890092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c85f7-35fc-49fb-9d48-eee77dd986a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.891594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c85f7-35fc-49fb-9d48-eee77dd986a8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.908708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 532/1047] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:16.909735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c85f7-35fc-49fb-9d48-eee77dd986a8 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.922198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8d44-22b5-46b5-9f4b-056b3e435113 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:16.959673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d795-78f5-4beb-8d9b-cab1d03b5208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:16.960351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d795-78f5-4beb-8d9b-cab1d03b5208 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:16.960639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d795-78f5-4beb-8d9b-cab1d03b5208 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:16.960919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5d795-78f5-4beb-8d9b-cab1d03b5208 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:16.961673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5d795-78f5-4beb-8d9b-cab1d03b5208 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:16.961980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5d795-78f5-4beb-8d9b-cab1d03b5208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:16.963579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5d795-78f5-4beb-8d9b-cab1d03b5208 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:16.972421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 516/1048] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:16.978629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d795-78f5-4beb-8d9b-cab1d03b5208 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:16.994880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.016085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c85f7-35fc-49fb-9d48-eee77dd986a8 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.051503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3987ba8-58c7-4e8d-8a1c-225068d37e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.052733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3987ba8-58c7-4e8d-8a1c-225068d37e78 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.053015 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3987ba8-58c7-4e8d-8a1c-225068d37e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.053292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3987ba8-58c7-4e8d-8a1c-225068d37e78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.054129 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3987ba8-58c7-4e8d-8a1c-225068d37e78 None admin] RBAC: Adding query filter params (role.id=08ce118e12014a0dba5eda04a1cd8232, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6cba70fa423e413a9222021116ff5718) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:17.054482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3987ba8-58c7-4e8d-8a1c-225068d37e78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.055912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3987ba8-58c7-4e8d-8a1c-225068d37e78 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.063862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 533/1049] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/role_assignments?user.id=6cba70fa423e413a9222021116ff5718&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=08ce118e12014a0dba5eda04a1cd8232 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:17.088344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5d795-78f5-4beb-8d9b-cab1d03b5208 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.127756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994c32-df30-4a02-9bcf-bb7caae532f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.128663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994c32-df30-4a02-9bcf-bb7caae532f7 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.128949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994c32-df30-4a02-9bcf-bb7caae532f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.129226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994c32-df30-4a02-9bcf-bb7caae532f7 None admin] PATH_INFO: `/v3/users/0fd193d710b14738bc6000574743059b` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.145230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83994c32-df30-4a02-9bcf-bb7caae532f7 None admin] RBAC: Authorizing `identity:get_user(user_id=0fd193d710b14738bc6000574743059b)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.146692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83994c32-df30-4a02-9bcf-bb7caae532f7 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.148680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 517/1050] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:16 2022] GET /identity/v3/users/0fd193d710b14738bc6000574743059b => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:17.154505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3987ba8-58c7-4e8d-8a1c-225068d37e78 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.206027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.269019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3987ba8-58c7-4e8d-8a1c-225068d37e78 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.303324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aff00-f03b-46d4-951a-9986dd5da736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.303980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aff00-f03b-46d4-951a-9986dd5da736 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.304264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aff00-f03b-46d4-951a-9986dd5da736 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.304544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973aff00-f03b-46d4-951a-9986dd5da736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.372351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973aff00-f03b-46d4-951a-9986dd5da736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.373790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973aff00-f03b-46d4-951a-9986dd5da736 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.415121 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.478437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 534/1051] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:17.481225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994c32-df30-4a02-9bcf-bb7caae532f7 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.562209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:17.598566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994c32-df30-4a02-9bcf-bb7caae532f7 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.634110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026ea5-7dc7-4f31-8968-d818b45f25e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.635010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026ea5-7dc7-4f31-8968-d818b45f25e8 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.635296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026ea5-7dc7-4f31-8968-d818b45f25e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.635572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026ea5-7dc7-4f31-8968-d818b45f25e8 None admin] PATH_INFO: `/v3/projects/fa2117a752a6470ba94633a048853441` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.636819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026ea5-7dc7-4f31-8968-d818b45f25e8 None admin] RBAC: Authorizing `identity:get_project(project_id=fa2117a752a6470ba94633a048853441)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.638366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026ea5-7dc7-4f31-8968-d818b45f25e8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.645155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 518/1052] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/projects/fa2117a752a6470ba94633a048853441 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:17.646973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aff00-f03b-46d4-951a-9986dd5da736 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:17.750225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973aff00-f03b-46d4-951a-9986dd5da736 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:17.785275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f56a3-7cdd-41e0-a300-2dac91b1f4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:17.785947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f56a3-7cdd-41e0-a300-2dac91b1f4b4 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:17.786268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f56a3-7cdd-41e0-a300-2dac91b1f4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:17.786573 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f56a3-7cdd-41e0-a300-2dac91b1f4b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:17.787409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f56a3-7cdd-41e0-a300-2dac91b1f4b4 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=fa2117a752a6470ba94633a048853441, user.id=0fd193d710b14738bc6000574743059b) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:17.787722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f56a3-7cdd-41e0-a300-2dac91b1f4b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:17.789161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f56a3-7cdd-41e0-a300-2dac91b1f4b4 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:17.802429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 535/1053] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:17 2022] GET /identity/v3/role_assignments?user.id=0fd193d710b14738bc6000574743059b&scope.project.id=fa2117a752a6470ba94633a048853441&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:18.633182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86887f-4461-4fc2-8ae6-175be82c1a9b None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.633692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86887f-4461-4fc2-8ae6-175be82c1a9b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.633769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86887f-4461-4fc2-8ae6-175be82c1a9b None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.635251 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 519/1054] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:18.640282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb3ddc-583e-49fc-8eb3-19a4f04595b4 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.640687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb3ddc-583e-49fc-8eb3-19a4f04595b4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.640869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb3ddc-583e-49fc-8eb3-19a4f04595b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.646845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:18.659688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4fcb3ddc-583e-49fc-8eb3-19a4f04595b4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:18.660860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4fcb3ddc-583e-49fc-8eb3-19a4f04595b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:18.728237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 536/1055] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:18.750360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86887f-4461-4fc2-8ae6-175be82c1a9b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:18.852819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86887f-4461-4fc2-8ae6-175be82c1a9b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:18.890195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8b0bb-d089-4c17-aa69-ce15ffb53307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:18.891000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8b0bb-d089-4c17-aa69-ce15ffb53307 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:18.891282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8b0bb-d089-4c17-aa69-ce15ffb53307 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:18.891550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8b0bb-d089-4c17-aa69-ce15ffb53307 None admin] PATH_INFO: `/v3/services/image` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:18.892194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8b0bb-d089-4c17-aa69-ce15ffb53307 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:18.893556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8b0bb-d089-4c17-aa69-ce15ffb53307 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-14f8b0bb-d089-4c17-aa69-ce15ffb53307 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:18.905061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:18.906085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 18:38:18.906971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:18.910699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 520/1056] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jun 16 18:38:18 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:18.912326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb3ddc-583e-49fc-8eb3-19a4f04595b4 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.012181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb3ddc-583e-49fc-8eb3-19a4f04595b4 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:19.046310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44399b5c-a2f0-42f6-a90f-bb2ca2b8ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:19.046998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44399b5c-a2f0-42f6-a90f-bb2ca2b8ab84 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.047277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44399b5c-a2f0-42f6-a90f-bb2ca2b8ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.047550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44399b5c-a2f0-42f6-a90f-bb2ca2b8ab84 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.048247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44399b5c-a2f0-42f6-a90f-bb2ca2b8ab84 None admin] RBAC: Adding query filter params (name=image) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:19.048552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44399b5c-a2f0-42f6-a90f-bb2ca2b8ab84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:19.049923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44399b5c-a2f0-42f6-a90f-bb2ca2b8ab84 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:19.050999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:19.061327 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 537/1057] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:19.062531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8b0bb-d089-4c17-aa69-ce15ffb53307 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.065677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:19.170134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8b0bb-d089-4c17-aa69-ce15ffb53307 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:19.205146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf904f7-568a-4de4-babc-dbec97cedbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:19.205806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf904f7-568a-4de4-babc-dbec97cedbc4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.206087 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf904f7-568a-4de4-babc-dbec97cedbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.206359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf904f7-568a-4de4-babc-dbec97cedbc4 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.207085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf904f7-568a-4de4-babc-dbec97cedbc4 None admin] RBAC: Adding query filter params (type=image) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:19.207385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf904f7-568a-4de4-babc-dbec97cedbc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:19.208776 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf904f7-568a-4de4-babc-dbec97cedbc4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:19.211217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3cc60-1d2b-4b78-9354-a32d03b72e96 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.211504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3cc60-1d2b-4b78-9354-a32d03b72e96 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.211781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3cc60-1d2b-4b78-9354-a32d03b72e96 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.213263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 538/1058] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:19.218415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 521/1059] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:19.218554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e045-0bfd-4c18-a58a-e3cdd1db2ff6 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.218554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e045-0bfd-4c18-a58a-e3cdd1db2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.218554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6e045-0bfd-4c18-a58a-e3cdd1db2ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.220170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf904f7-568a-4de4-babc-dbec97cedbc4 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.235564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-cae6e045-0bfd-4c18-a58a-e3cdd1db2ff6 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:19.236731 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-cae6e045-0bfd-4c18-a58a-e3cdd1db2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:19.290577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:19.314753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 539/1060] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:19.328963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf904f7-568a-4de4-babc-dbec97cedbc4 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:19.329154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6e045-0bfd-4c18-a58a-e3cdd1db2ff6 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.367487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e9acd-1669-4e3a-9d9e-b0633cb59b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:19.368655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e9acd-1669-4e3a-9d9e-b0633cb59b89 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.368992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e9acd-1669-4e3a-9d9e-b0633cb59b89 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.369268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e9acd-1669-4e3a-9d9e-b0633cb59b89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.370000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e9acd-1669-4e3a-9d9e-b0633cb59b89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:19.371415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e9acd-1669-4e3a-9d9e-b0633cb59b89 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:19.394619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 522/1061] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jun 16 18:38:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:38:19.440689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6e045-0bfd-4c18-a58a-e3cdd1db2ff6 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:19.471196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:19.487026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982e3d9-0e35-4796-9507-cbfb9043a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:19.487870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982e3d9-0e35-4796-9507-cbfb9043a495 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.488156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982e3d9-0e35-4796-9507-cbfb9043a495 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.488433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982e3d9-0e35-4796-9507-cbfb9043a495 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.508784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982e3d9-0e35-4796-9507-cbfb9043a495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-6982e3d9-0e35-4796-9507-cbfb9043a495 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:19.517214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:19.518234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:19.519461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 540/1062] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:19.527720 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e9acd-1669-4e3a-9d9e-b0633cb59b89 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.641280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e9acd-1669-4e3a-9d9e-b0633cb59b89 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:19.664634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:19.678147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052b6e-023f-4915-a98b-f85597e2b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:19.678978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052b6e-023f-4915-a98b-f85597e2b0c3 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.679259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052b6e-023f-4915-a98b-f85597e2b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.679531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052b6e-023f-4915-a98b-f85597e2b0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.680280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052b6e-023f-4915-a98b-f85597e2b0c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:19.680585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052b6e-023f-4915-a98b-f85597e2b0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:19.681954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052b6e-023f-4915-a98b-f85597e2b0c3 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:19.691560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 523/1063] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:19.697988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982e3d9-0e35-4796-9507-cbfb9043a495 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.802064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982e3d9-0e35-4796-9507-cbfb9043a495 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:19.837036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6315bd9-be5f-47e9-b01d-1d217f3864ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:19.837832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315bd9-be5f-47e9-b01d-1d217f3864ed None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.838110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315bd9-be5f-47e9-b01d-1d217f3864ed None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.838391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315bd9-be5f-47e9-b01d-1d217f3864ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.849999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6315bd9-be5f-47e9-b01d-1d217f3864ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:19.851480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6315bd9-be5f-47e9-b01d-1d217f3864ed None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-a6315bd9-be5f-47e9-b01d-1d217f3864ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:19.869012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:19.869982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:19.871424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:19.871424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:19.871424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:19.871424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:19.871424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 541/1064] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:19.876213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052b6e-023f-4915-a98b-f85597e2b0c3 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:19.950637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30b24-ff5e-4865-baeb-132400430a51 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.950853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30b24-ff5e-4865-baeb-132400430a51 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.951132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de30b24-ff5e-4865-baeb-132400430a51 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.952765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 542/1065] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:38:19.957746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15855d35-6432-4662-978b-a02620881888 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:19.958610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15855d35-6432-4662-978b-a02620881888 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:19.958892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15855d35-6432-4662-978b-a02620881888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:19.985338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-15855d35-6432-4662-978b-a02620881888 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:19.986584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-15855d35-6432-4662-978b-a02620881888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:19.989580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052b6e-023f-4915-a98b-f85597e2b0c3 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.018682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.028659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db9122-c41e-4593-bcb4-809c779c172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.029335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9122-c41e-4593-bcb4-809c779c172f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.029617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9122-c41e-4593-bcb4-809c779c172f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.029892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db9122-c41e-4593-bcb4-809c779c172f None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.030819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db9122-c41e-4593-bcb4-809c779c172f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:20.031012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db9122-c41e-4593-bcb4-809c779c172f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.032406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db9122-c41e-4593-bcb4-809c779c172f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.046080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 524/1066] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:20.051789 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db9122-c41e-4593-bcb4-809c779c172f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.066134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 543/1067] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:20.089635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15855d35-6432-4662-978b-a02620881888 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.106898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.171062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db9122-c41e-4593-bcb4-809c779c172f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.201042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15855d35-6432-4662-978b-a02620881888 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.217605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109b965-2a27-4ea2-95d3-60643f9a2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.218417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109b965-2a27-4ea2-95d3-60643f9a2862 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.218703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109b965-2a27-4ea2-95d3-60643f9a2862 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.218978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109b965-2a27-4ea2-95d3-60643f9a2862 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.227695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109b965-2a27-4ea2-95d3-60643f9a2862 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.229137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109b965-2a27-4ea2-95d3-60643f9a2862 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.240236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c5985-6cbd-440e-a1cf-070baf0f733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.241038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c5985-6cbd-440e-a1cf-070baf0f733e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.241320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c5985-6cbd-440e-a1cf-070baf0f733e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.241598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c5985-6cbd-440e-a1cf-070baf0f733e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-e109b965-2a27-4ea2-95d3-60643f9a2862 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:20.251193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:20.252196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:20.253189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 525/1068] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:20.258431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c5985-6cbd-440e-a1cf-070baf0f733e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:20.258642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109b965-2a27-4ea2-95d3-60643f9a2862 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-722c5985-6cbd-440e-a1cf-070baf0f733e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:20.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:20.267110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:20.268379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 544/1069] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:20.274491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c5985-6cbd-440e-a1cf-070baf0f733e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.302843 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.366470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109b965-2a27-4ea2-95d3-60643f9a2862 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.369921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.391081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c5985-6cbd-440e-a1cf-070baf0f733e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.407541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ffeba-283e-41a0-a5fb-797fcb8d54ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.408208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ffeba-283e-41a0-a5fb-797fcb8d54ff None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.408489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ffeba-283e-41a0-a5fb-797fcb8d54ff None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.408762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ffeba-283e-41a0-a5fb-797fcb8d54ff None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.409597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ffeba-283e-41a0-a5fb-797fcb8d54ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:20.409901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ffeba-283e-41a0-a5fb-797fcb8d54ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.411359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ffeba-283e-41a0-a5fb-797fcb8d54ff None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.428093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b758fd4-7844-4f44-a2ae-2e75f4254230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.428840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b758fd4-7844-4f44-a2ae-2e75f4254230 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.433746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b758fd4-7844-4f44-a2ae-2e75f4254230 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.433973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 526/1070] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:20.434070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b758fd4-7844-4f44-a2ae-2e75f4254230 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.434070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b758fd4-7844-4f44-a2ae-2e75f4254230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:20.434070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b758fd4-7844-4f44-a2ae-2e75f4254230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.434070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b758fd4-7844-4f44-a2ae-2e75f4254230 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.435107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ffeba-283e-41a0-a5fb-797fcb8d54ff None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.442578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 545/1071] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:20.449333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b758fd4-7844-4f44-a2ae-2e75f4254230 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.556882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ffeba-283e-41a0-a5fb-797fcb8d54ff None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.560833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.577955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b758fd4-7844-4f44-a2ae-2e75f4254230 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.594713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d53f6d-0462-4cf3-9895-6b8ba34e093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.595674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d53f6d-0462-4cf3-9895-6b8ba34e093e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.596027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d53f6d-0462-4cf3-9895-6b8ba34e093e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.596302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d53f6d-0462-4cf3-9895-6b8ba34e093e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.607548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d53f6d-0462-4cf3-9895-6b8ba34e093e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.609233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d53f6d-0462-4cf3-9895-6b8ba34e093e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.620414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86497-a35b-49ad-ac71-e227e4fdd740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.621313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86497-a35b-49ad-ac71-e227e4fdd740 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.621593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86497-a35b-49ad-ac71-e227e4fdd740 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.621870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86497-a35b-49ad-ac71-e227e4fdd740 None admin] PATH_INFO: `/v3/users/0fd193d710b14738bc6000574743059b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.623131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e86497-a35b-49ad-ac71-e227e4fdd740 None admin] RBAC: Authorizing `identity:get_user(user_id=0fd193d710b14738bc6000574743059b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.624585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e86497-a35b-49ad-ac71-e227e4fdd740 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.626241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 546/1072] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/users/0fd193d710b14738bc6000574743059b => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-a4d53f6d-0462-4cf3-9895-6b8ba34e093e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:20.630713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:20.631777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:20.632849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:20.632849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:20.632849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:20.632849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:20.634294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86497-a35b-49ad-ac71-e227e4fdd740 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.635188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 527/1073] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:20.640591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d53f6d-0462-4cf3-9895-6b8ba34e093e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.656623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.746806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d53f6d-0462-4cf3-9895-6b8ba34e093e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.749743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86497-a35b-49ad-ac71-e227e4fdd740 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.784834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e75ddf-59d4-44c0-b0d4-3cb9fc58f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.785413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e75ddf-59d4-44c0-b0d4-3cb9fc58f6ec None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.785698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e75ddf-59d4-44c0-b0d4-3cb9fc58f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.785961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8050bb-6db1-4fe3-811e-f179cd5fbde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.786098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e75ddf-59d4-44c0-b0d4-3cb9fc58f6ec None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.786824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e75ddf-59d4-44c0-b0d4-3cb9fc58f6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:20.786921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8050bb-6db1-4fe3-811e-f179cd5fbde6 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.787140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8050bb-6db1-4fe3-811e-f179cd5fbde6 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.787248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e75ddf-59d4-44c0-b0d4-3cb9fc58f6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.787414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8050bb-6db1-4fe3-811e-f179cd5fbde6 None admin] PATH_INFO: `/v3/projects/fa2117a752a6470ba94633a048853441` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.788538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e75ddf-59d4-44c0-b0d4-3cb9fc58f6ec None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.788741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8050bb-6db1-4fe3-811e-f179cd5fbde6 None admin] RBAC: Authorizing `identity:get_project(project_id=fa2117a752a6470ba94633a048853441)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.790141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8050bb-6db1-4fe3-811e-f179cd5fbde6 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.797068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 547/1074] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/projects/fa2117a752a6470ba94633a048853441 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:20.798433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8050bb-6db1-4fe3-811e-f179cd5fbde6 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.802807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 528/1075] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:20.807828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e75ddf-59d4-44c0-b0d4-3cb9fc58f6ec None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:20.825798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.888606 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:20.902260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8050bb-6db1-4fe3-811e-f179cd5fbde6 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.917605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e75ddf-59d4-44c0-b0d4-3cb9fc58f6ec None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:20.938978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a002f-ae38-4bf4-adc1-75e93d85e0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.939868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a002f-ae38-4bf4-adc1-75e93d85e0d7 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.940150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a002f-ae38-4bf4-adc1-75e93d85e0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.940425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a002f-ae38-4bf4-adc1-75e93d85e0d7 None admin] PATH_INFO: `/v3/projects/fa2117a752a6470ba94633a048853441/users/0fd193d710b14738bc6000574743059b/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.942434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a002f-ae38-4bf4-adc1-75e93d85e0d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa2117a752a6470ba94633a048853441, user_id=0fd193d710b14738bc6000574743059b, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.943870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a002f-ae38-4bf4-adc1-75e93d85e0d7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.955555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbadaba-231d-43e6-ba82-acf4e4e04ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:20.956367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbadaba-231d-43e6-ba82-acf4e4e04ce8 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:20.956636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbadaba-231d-43e6-ba82-acf4e4e04ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:20.956907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbadaba-231d-43e6-ba82-acf4e4e04ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:20.957698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 548/1076] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:38:20 2022] PUT /identity/v3/projects/fa2117a752a6470ba94633a048853441/users/0fd193d710b14738bc6000574743059b/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:38:20.968805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbadaba-231d-43e6-ba82-acf4e4e04ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:20.970739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbadaba-231d-43e6-ba82-acf4e4e04ce8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-cdbadaba-231d-43e6-ba82-acf4e4e04ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:20.987515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:20.988522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:20.990029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:20.990029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:20.990029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:20.990029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:20.990029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:20.990029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:20.990029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:20.990029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:20.992763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 529/1077] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:20.998574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a002f-ae38-4bf4-adc1-75e93d85e0d7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:21.097569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:21.118552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a002f-ae38-4bf4-adc1-75e93d85e0d7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:21.156541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb481f-de6c-42f9-b477-5af26536a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:21.157208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb481f-de6c-42f9-b477-5af26536a474 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.157488 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb481f-de6c-42f9-b477-5af26536a474 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.157761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb481f-de6c-42f9-b477-5af26536a474 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.158578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb481f-de6c-42f9-b477-5af26536a474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:21.158888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb481f-de6c-42f9-b477-5af26536a474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:21.160344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb481f-de6c-42f9-b477-5af26536a474 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:21.174636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 549/1078] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:21.180442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbadaba-231d-43e6-ba82-acf4e4e04ce8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:21.283596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbadaba-231d-43e6-ba82-acf4e4e04ce8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:21.319149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50909-279d-48f9-be46-d4261be83ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:21.320033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50909-279d-48f9-be46-d4261be83ed4 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.320314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50909-279d-48f9-be46-d4261be83ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.320588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50909-279d-48f9-be46-d4261be83ed4 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6cba70fa423e413a9222021116ff5718/roles/08ce118e12014a0dba5eda04a1cd8232` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.322825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50909-279d-48f9-be46-d4261be83ed4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=6cba70fa423e413a9222021116ff5718, role_id=08ce118e12014a0dba5eda04a1cd8232)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:21.324270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50909-279d-48f9-be46-d4261be83ed4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:21.326615 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:21.339200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 530/1079] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:38:21 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/6cba70fa423e413a9222021116ff5718/roles/08ce118e12014a0dba5eda04a1cd8232 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:38:21.631200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6566-c01e-472e-8bef-47e11084969a None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.631550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6566-c01e-472e-8bef-47e11084969a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.631760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6566-c01e-472e-8bef-47e11084969a None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.633241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 550/1080] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:21.638699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a37d81-4a50-4971-9fc9-19ac08390f9d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.638989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a37d81-4a50-4971-9fc9-19ac08390f9d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.639265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a37d81-4a50-4971-9fc9-19ac08390f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.657173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-74a37d81-4a50-4971-9fc9-19ac08390f9d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:21.658365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-74a37d81-4a50-4971-9fc9-19ac08390f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:21.730432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 531/1081] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:21.750515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6566-c01e-472e-8bef-47e11084969a None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:21.858048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6566-c01e-472e-8bef-47e11084969a None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:21.892559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6017a87-505f-446b-b20f-51f79f81018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:21.893213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6017a87-505f-446b-b20f-51f79f81018e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:21.893496 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6017a87-505f-446b-b20f-51f79f81018e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:21.893775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6017a87-505f-446b-b20f-51f79f81018e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:21.908995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:21.963725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6017a87-505f-446b-b20f-51f79f81018e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:21.965160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6017a87-505f-446b-b20f-51f79f81018e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:22.068076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 551/1082] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:22.073945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a37d81-4a50-4971-9fc9-19ac08390f9d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:22.181295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a37d81-4a50-4971-9fc9-19ac08390f9d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:22.205344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:22.218796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94619f-d48e-483d-97a4-0e92f615dee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:22.219595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94619f-d48e-483d-97a4-0e92f615dee6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:22.219875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94619f-d48e-483d-97a4-0e92f615dee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:22.220148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94619f-d48e-483d-97a4-0e92f615dee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:22.231053 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94619f-d48e-483d-97a4-0e92f615dee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:22.232506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94619f-d48e-483d-97a4-0e92f615dee6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-9e94619f-d48e-483d-97a4-0e92f615dee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:22.249976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:22.251118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:22.252112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:22.252112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:22.252112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:22.252112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:22.252835 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 532/1083] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:22.257735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6017a87-505f-446b-b20f-51f79f81018e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:22.306841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:22.367619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6017a87-505f-446b-b20f-51f79f81018e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:22.401979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf8109-1fba-4ce2-8158-90e397efa0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:22.402692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8109-1fba-4ce2-8158-90e397efa0da None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:22.402981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8109-1fba-4ce2-8158-90e397efa0da None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:22.403259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8109-1fba-4ce2-8158-90e397efa0da None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:22.403981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf8109-1fba-4ce2-8158-90e397efa0da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:22.404292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf8109-1fba-4ce2-8158-90e397efa0da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:22.405649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf8109-1fba-4ce2-8158-90e397efa0da None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:22.426425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 552/1084] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:23.105330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0536a-995f-4d8f-947f-6d67a74016ba None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.105928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0536a-995f-4d8f-947f-6d67a74016ba None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.105928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0536a-995f-4d8f-947f-6d67a74016ba None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.107307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 533/1085] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:23.112789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd06b-a3d1-43f6-9978-6b38dfcbe704 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.113215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd06b-a3d1-43f6-9978-6b38dfcbe704 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.113345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd06b-a3d1-43f6-9978-6b38dfcbe704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.129644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-9c0fd06b-a3d1-43f6-9978-6b38dfcbe704 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:23.131503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9c0fd06b-a3d1-43f6-9978-6b38dfcbe704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:23.196737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 553/1086] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:23.220294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0536a-995f-4d8f-947f-6d67a74016ba None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.320260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0536a-995f-4d8f-947f-6d67a74016ba None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:23.353932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6f7a-d904-45d8-99d0-801b067df07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:23.354751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6f7a-d904-45d8-99d0-801b067df07f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.355039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6f7a-d904-45d8-99d0-801b067df07f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.355318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6f7a-d904-45d8-99d0-801b067df07f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.366013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda6f7a-d904-45d8-99d0-801b067df07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-6eda6f7a-d904-45d8-99d0-801b067df07f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:23.373674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:23.374815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:23.375687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 534/1087] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:23.381772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fd06b-a3d1-43f6-9978-6b38dfcbe704 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.414005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.488304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fd06b-a3d1-43f6-9978-6b38dfcbe704 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:23.501191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28f4e9-9aca-4c35-a208-4afad5c3c3a7 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.501532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28f4e9-9aca-4c35-a208-4afad5c3c3a7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.501761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28f4e9-9aca-4c35-a208-4afad5c3c3a7 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.503172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 535/1088] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:23.508823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c1e22-74f2-4c23-a283-94348b8a10c7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.509108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c1e22-74f2-4c23-a283-94348b8a10c7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.509386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c1e22-74f2-4c23-a283-94348b8a10c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.526743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-470c1e22-74f2-4c23-a283-94348b8a10c7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:23.527913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-470c1e22-74f2-4c23-a283-94348b8a10c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:23.532484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83cbee-45a7-41f2-80e1-d960db90f91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:23.533161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83cbee-45a7-41f2-80e1-d960db90f91d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.533448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83cbee-45a7-41f2-80e1-d960db90f91d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.533726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83cbee-45a7-41f2-80e1-d960db90f91d None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.534511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83cbee-45a7-41f2-80e1-d960db90f91d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:23.534827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83cbee-45a7-41f2-80e1-d960db90f91d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:23.536196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83cbee-45a7-41f2-80e1-d960db90f91d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:23.545236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 554/1089] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:23.551146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83cbee-45a7-41f2-80e1-d960db90f91d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.562494 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.602851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 536/1090] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:23.627013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c1e22-74f2-4c23-a283-94348b8a10c7 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.649796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.656501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83cbee-45a7-41f2-80e1-d960db90f91d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:23.689960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e4a6c-2bdc-46db-8785-4e28fb940656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:23.690852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e4a6c-2bdc-46db-8785-4e28fb940656 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.691138 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e4a6c-2bdc-46db-8785-4e28fb940656 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.691412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e4a6c-2bdc-46db-8785-4e28fb940656 None admin] PATH_INFO: `/v3/users/0fd193d710b14738bc6000574743059b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.693081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e4a6c-2bdc-46db-8785-4e28fb940656 None admin] RBAC: Authorizing `identity:get_user(user_id=0fd193d710b14738bc6000574743059b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:23.694526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e4a6c-2bdc-46db-8785-4e28fb940656 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:23.696157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 555/1091] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/users/0fd193d710b14738bc6000574743059b => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:23.701682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e4a6c-2bdc-46db-8785-4e28fb940656 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.725381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c1e22-74f2-4c23-a283-94348b8a10c7 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:23.758629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e8922-1f2f-4d07-a417-1695f91f5634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:23.759426 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e8922-1f2f-4d07-a417-1695f91f5634 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.759705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e8922-1f2f-4d07-a417-1695f91f5634 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.759976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e8922-1f2f-4d07-a417-1695f91f5634 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.769858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e8922-1f2f-4d07-a417-1695f91f5634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-554e8922-1f2f-4d07-a417-1695f91f5634 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:23.778506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:23.779424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:23.780264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 537/1092] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:23.785547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e8922-1f2f-4d07-a417-1695f91f5634 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:23.801548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e4a6c-2bdc-46db-8785-4e28fb940656 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:23.812304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.836849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af42a-4372-465e-be7f-8196fb50578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:23.837504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af42a-4372-465e-be7f-8196fb50578b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.837792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af42a-4372-465e-be7f-8196fb50578b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.838074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af42a-4372-465e-be7f-8196fb50578b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.867648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.886319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e8922-1f2f-4d07-a417-1695f91f5634 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:23.907304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af42a-4372-465e-be7f-8196fb50578b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:23.908745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af42a-4372-465e-be7f-8196fb50578b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:23.920035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9399850-ff8d-4892-aeb8-df00945de270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:23.920696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9399850-ff8d-4892-aeb8-df00945de270 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:23.920975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9399850-ff8d-4892-aeb8-df00945de270 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:23.921250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9399850-ff8d-4892-aeb8-df00945de270 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:23.921999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9399850-ff8d-4892-aeb8-df00945de270 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:23.922300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9399850-ff8d-4892-aeb8-df00945de270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:23.923698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9399850-ff8d-4892-aeb8-df00945de270 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:23.932079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 538/1093] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:23.937476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9399850-ff8d-4892-aeb8-df00945de270 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.006430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 556/1094] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 18:38:24.012380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af42a-4372-465e-be7f-8196fb50578b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.031882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.045709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9399850-ff8d-4892-aeb8-df00945de270 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.077583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.080521 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d7a08-a021-4a13-980a-adfc667915d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.081300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d7a08-a021-4a13-980a-adfc667915d5 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.081588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d7a08-a021-4a13-980a-adfc667915d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.081864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d7a08-a021-4a13-980a-adfc667915d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.092991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d7a08-a021-4a13-980a-adfc667915d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.094460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d7a08-a021-4a13-980a-adfc667915d5 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-e70d7a08-a021-4a13-980a-adfc667915d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:24.111349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:24.112836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:24.113713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:24.113713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:24.113713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:24.113713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:24.113713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 539/1095] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:38:24.116154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af42a-4372-465e-be7f-8196fb50578b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.118831 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d7a08-a021-4a13-980a-adfc667915d5 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.151021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1b15-0900-4205-861b-1dbb69c4fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.151806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1b15-0900-4205-861b-1dbb69c4fb15 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.152085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1b15-0900-4205-861b-1dbb69c4fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.152350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1b15-0900-4205-861b-1dbb69c4fb15 None admin] PATH_INFO: `/v3/projects/fa2117a752a6470ba94633a048853441` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.153520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa1b15-0900-4205-861b-1dbb69c4fb15 None admin] RBAC: Authorizing `identity:get_project(project_id=fa2117a752a6470ba94633a048853441)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.154965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa1b15-0900-4205-861b-1dbb69c4fb15 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.156657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 557/1096] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:24 2022] GET /identity/v3/projects/fa2117a752a6470ba94633a048853441 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:24.162721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1b15-0900-4205-861b-1dbb69c4fb15 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.221627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d7a08-a021-4a13-980a-adfc667915d5 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.254989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ac7a1-8293-4c01-a568-c8b26d88484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.256163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ac7a1-8293-4c01-a568-c8b26d88484e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.256449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ac7a1-8293-4c01-a568-c8b26d88484e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.256725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ac7a1-8293-4c01-a568-c8b26d88484e None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.257441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ac7a1-8293-4c01-a568-c8b26d88484e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:24.257751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ac7a1-8293-4c01-a568-c8b26d88484e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.259154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ac7a1-8293-4c01-a568-c8b26d88484e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.264438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1b15-0900-4205-861b-1dbb69c4fb15 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.267960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.276478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 540/1097] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:24.277383 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ac7a1-8293-4c01-a568-c8b26d88484e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.294420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.300540 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9118c-eb22-45df-8d32-dfc1253355ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.301450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9118c-eb22-45df-8d32-dfc1253355ef None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.301743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9118c-eb22-45df-8d32-dfc1253355ef None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.302565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9118c-eb22-45df-8d32-dfc1253355ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.303405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9118c-eb22-45df-8d32-dfc1253355ef None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=fa2117a752a6470ba94633a048853441, user.id=0fd193d710b14738bc6000574743059b) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:24.303717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9118c-eb22-45df-8d32-dfc1253355ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.305165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9118c-eb22-45df-8d32-dfc1253355ef None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.311146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 558/1098] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:24 2022] GET /identity/v3/role_assignments?user.id=0fd193d710b14738bc6000574743059b&scope.project.id=fa2117a752a6470ba94633a048853441&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:24.386120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ac7a1-8293-4c01-a568-c8b26d88484e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.422639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa06de-a04b-4187-abe4-cc213a8e1dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.423365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa06de-a04b-4187-abe4-cc213a8e1dab None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.423650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa06de-a04b-4187-abe4-cc213a8e1dab None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.423927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa06de-a04b-4187-abe4-cc213a8e1dab None admin] PATH_INFO: `/v3/users/nova` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.432744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa06de-a04b-4187-abe4-cc213a8e1dab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.434219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa06de-a04b-4187-abe4-cc213a8e1dab None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-e1fa06de-a04b-4187-abe4-cc213a8e1dab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:38:24.450712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:24.451922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:24.453007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 541/1099] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jun 16 18:38:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:24.458236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9118c-eb22-45df-8d32-dfc1253355ef None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.565376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9118c-eb22-45df-8d32-dfc1253355ef None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.599747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640320-690d-4deb-8938-adca820f9dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.600432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640320-690d-4deb-8938-adca820f9dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.600719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640320-690d-4deb-8938-adca820f9dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.600997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640320-690d-4deb-8938-adca820f9dd7 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.601848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640320-690d-4deb-8938-adca820f9dd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:24.602160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640320-690d-4deb-8938-adca820f9dd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.603612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640320-690d-4deb-8938-adca820f9dd7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.621760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 559/1100] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jun 16 18:38:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:24.627567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa06de-a04b-4187-abe4-cc213a8e1dab None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.687804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.730014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa06de-a04b-4187-abe4-cc213a8e1dab None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:24.763809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25572c8-8e32-4ce1-894a-49dbfda94f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:24.764460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25572c8-8e32-4ce1-894a-49dbfda94f24 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:24.764752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25572c8-8e32-4ce1-894a-49dbfda94f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:24.765032 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25572c8-8e32-4ce1-894a-49dbfda94f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:24.833903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25572c8-8e32-4ce1-894a-49dbfda94f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:24.835421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25572c8-8e32-4ce1-894a-49dbfda94f24 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:24.892511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:24.933573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 542/1101] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:24.939789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640320-690d-4deb-8938-adca820f9dd7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:24.994448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:25.038326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640320-690d-4deb-8938-adca820f9dd7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:25.072556 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b251-76bf-445b-aee4-5313eae7651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:25.073343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b251-76bf-445b-aee4-5313eae7651d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:25.073626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b251-76bf-445b-aee4-5313eae7651d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:25.073898 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b251-76bf-445b-aee4-5313eae7651d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:25.084182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b251-76bf-445b-aee4-5313eae7651d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:25.085606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b251-76bf-445b-aee4-5313eae7651d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-2943b251-76bf-445b-aee4-5313eae7651d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:25.103434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:25.104571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:25.105524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:38:25.105524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:25.105524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:38:25.105524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:25.106588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 560/1102] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:25.111333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25572c8-8e32-4ce1-894a-49dbfda94f24 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:25.221013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25572c8-8e32-4ce1-894a-49dbfda94f24 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:25.254958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628006e-bcae-45ed-ae55-509a279cac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:25.255623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628006e-bcae-45ed-ae55-509a279cac7c None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:25.255906 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628006e-bcae-45ed-ae55-509a279cac7c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:25.256178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628006e-bcae-45ed-ae55-509a279cac7c None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:25.256893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628006e-bcae-45ed-ae55-509a279cac7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:25.257195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628006e-bcae-45ed-ae55-509a279cac7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:25.258587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628006e-bcae-45ed-ae55-509a279cac7c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:25.270342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 543/1103] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:25.275885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b251-76bf-445b-aee4-5313eae7651d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:25.380041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b251-76bf-445b-aee4-5313eae7651d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:25.387567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:25.414218 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17900-5076-4705-9808-b72d0acf9673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:25.415055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17900-5076-4705-9808-b72d0acf9673 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:25.415337 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17900-5076-4705-9808-b72d0acf9673 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:25.415611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17900-5076-4705-9808-b72d0acf9673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:25.422133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17900-5076-4705-9808-b72d0acf9673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:25.423590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17900-5076-4705-9808-b72d0acf9673 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-dbf17900-5076-4705-9808-b72d0acf9673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:38:25.437852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:25.439383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:25.440432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:38:25.440432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:38:25.440432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:25.440432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:25.440432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:25.440432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:25.440432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:38:25.440432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:25.442598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 561/1104] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:25.446041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628006e-bcae-45ed-ae55-509a279cac7c None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:25.469893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:25.552571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628006e-bcae-45ed-ae55-509a279cac7c None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:25.586328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76892eea-45ab-4d3b-bacb-5650f8de1288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:25.587024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76892eea-45ab-4d3b-bacb-5650f8de1288 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:25.587306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76892eea-45ab-4d3b-bacb-5650f8de1288 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:25.587578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76892eea-45ab-4d3b-bacb-5650f8de1288 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:25.588366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76892eea-45ab-4d3b-bacb-5650f8de1288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:25.588676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76892eea-45ab-4d3b-bacb-5650f8de1288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:25.590118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76892eea-45ab-4d3b-bacb-5650f8de1288 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:25.603880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 544/1105] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:25.609707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17900-5076-4705-9808-b72d0acf9673 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:25.711987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17900-5076-4705-9808-b72d0acf9673 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:25.745639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a6a4e-5586-41bc-892d-66558edde63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:25.746303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a6a4e-5586-41bc-892d-66558edde63a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:25.746626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a6a4e-5586-41bc-892d-66558edde63a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:25.746906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a6a4e-5586-41bc-892d-66558edde63a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:25.747752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a6a4e-5586-41bc-892d-66558edde63a None admin] RBAC: Adding query filter params (role.id=08ce118e12014a0dba5eda04a1cd8232, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=6cba70fa423e413a9222021116ff5718) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:25.748070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a6a4e-5586-41bc-892d-66558edde63a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:25.749513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a6a4e-5586-41bc-892d-66558edde63a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:25.755944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 562/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:25 2022] GET /identity/v3/role_assignments?user.id=6cba70fa423e413a9222021116ff5718&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=08ce118e12014a0dba5eda04a1cd8232 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:26.518930 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2d2b-1c70-4585-a82e-e6fe5a493a91 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.519419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2d2b-1c70-4585-a82e-e6fe5a493a91 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.519523 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2d2b-1c70-4585-a82e-e6fe5a493a91 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.521033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 545/1107] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:26.526314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd65f9-2059-4621-9954-b13f8ecf7c50 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.526776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd65f9-2059-4621-9954-b13f8ecf7c50 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.526939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd65f9-2059-4621-9954-b13f8ecf7c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.543717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-84bd65f9-2059-4621-9954-b13f8ecf7c50 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:26.544918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-84bd65f9-2059-4621-9954-b13f8ecf7c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:26.569959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:26.613135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 563/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:26.638710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e2d2b-1c70-4585-a82e-e6fe5a493a91 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:26.722277 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:26.745551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e2d2b-1c70-4585-a82e-e6fe5a493a91 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:26.779280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278271cd-3952-4484-9209-5eb69ffb6967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:26.779995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278271cd-3952-4484-9209-5eb69ffb6967 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.780272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278271cd-3952-4484-9209-5eb69ffb6967 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.780545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278271cd-3952-4484-9209-5eb69ffb6967 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.781717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278271cd-3952-4484-9209-5eb69ffb6967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:26.783178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278271cd-3952-4484-9209-5eb69ffb6967 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:26.784805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 546/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:26.791013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd65f9-2059-4621-9954-b13f8ecf7c50 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:26.890990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd65f9-2059-4621-9954-b13f8ecf7c50 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:26.923446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e752f98-103a-4e02-b22c-474c1fe575e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:26.924101 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e752f98-103a-4e02-b22c-474c1fe575e5 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:26.924383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e752f98-103a-4e02-b22c-474c1fe575e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:26.924655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e752f98-103a-4e02-b22c-474c1fe575e5 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:26.925365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e752f98-103a-4e02-b22c-474c1fe575e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:26.926824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e752f98-103a-4e02-b22c-474c1fe575e5 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:26.945954 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 564/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:38:26 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:29.105069 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f245-4095-423b-9c1e-a5779b72539d None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.105635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f245-4095-423b-9c1e-a5779b72539d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.105635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f245-4095-423b-9c1e-a5779b72539d None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.107325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 547/1111] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:29.113531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6192-96b7-496d-b0ec-1e318d02d05d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.114062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6192-96b7-496d-b0ec-1e318d02d05d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.114192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd6192-96b7-496d-b0ec-1e318d02d05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.133974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-76dd6192-96b7-496d-b0ec-1e318d02d05d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:29.135191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-76dd6192-96b7-496d-b0ec-1e318d02d05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:29.146192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:29.202065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 565/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:29.225510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2f245-4095-423b-9c1e-a5779b72539d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.325285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2f245-4095-423b-9c1e-a5779b72539d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.360134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443b807-6224-40f5-a498-db39bbb8705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.360907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443b807-6224-40f5-a498-db39bbb8705a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.361191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443b807-6224-40f5-a498-db39bbb8705a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.361467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443b807-6224-40f5-a498-db39bbb8705a None admin] PATH_INFO: `/v3/roles/85059d55a9ee403aa18b9580d26ccbed` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.362974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443b807-6224-40f5-a498-db39bbb8705a None admin] RBAC: Authorizing `identity:get_role(role_id=85059d55a9ee403aa18b9580d26ccbed)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.364371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443b807-6224-40f5-a498-db39bbb8705a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.365768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 548/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/roles/85059d55a9ee403aa18b9580d26ccbed => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:29.371763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6192-96b7-496d-b0ec-1e318d02d05d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.475227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd6192-96b7-496d-b0ec-1e318d02d05d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.508452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86b886-9f31-42ef-b56e-dd4343830260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.509324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86b886-9f31-42ef-b56e-dd4343830260 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.509600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86b886-9f31-42ef-b56e-dd4343830260 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.509868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86b886-9f31-42ef-b56e-dd4343830260 None admin] PATH_INFO: `/v3/users/8826568fb6d044389120182ed47b03a4` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.523606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86b886-9f31-42ef-b56e-dd4343830260 None admin] RBAC: Authorizing `identity:get_user(user_id=8826568fb6d044389120182ed47b03a4)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.525030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86b886-9f31-42ef-b56e-dd4343830260 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.526702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 566/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/users/8826568fb6d044389120182ed47b03a4 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:29.532583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443b807-6224-40f5-a498-db39bbb8705a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.550975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:29.631442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443b807-6224-40f5-a498-db39bbb8705a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:29.670986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a23d19-0433-44e0-ae3f-253dcd9d2a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:29.671633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a23d19-0433-44e0-ae3f-253dcd9d2a3c None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:29.671916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a23d19-0433-44e0-ae3f-253dcd9d2a3c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:29.672198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a23d19-0433-44e0-ae3f-253dcd9d2a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:29.741518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a23d19-0433-44e0-ae3f-253dcd9d2a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:29.743452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a23d19-0433-44e0-ae3f-253dcd9d2a3c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:29.763930 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:29.854282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 549/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:29.860300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86b886-9f31-42ef-b56e-dd4343830260 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:29.866009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:29.980520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86b886-9f31-42ef-b56e-dd4343830260 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.015283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655bafd-59b1-448f-8004-d34838bc4ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.016143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655bafd-59b1-448f-8004-d34838bc4ee4 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.016425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655bafd-59b1-448f-8004-d34838bc4ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.016700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655bafd-59b1-448f-8004-d34838bc4ee4 None admin] PATH_INFO: `/v3/projects/fa2117a752a6470ba94633a048853441` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.017895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655bafd-59b1-448f-8004-d34838bc4ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=fa2117a752a6470ba94633a048853441)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.019354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655bafd-59b1-448f-8004-d34838bc4ee4 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.021628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 567/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:29 2022] GET /identity/v3/projects/fa2117a752a6470ba94633a048853441 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:30.028039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a23d19-0433-44e0-ae3f-253dcd9d2a3c None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:30.129435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a23d19-0433-44e0-ae3f-253dcd9d2a3c None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:30.146652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:30.164440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080474ab-e159-45b5-bdc7-8642785743ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:30.165091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080474ab-e159-45b5-bdc7-8642785743ba None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:30.165375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080474ab-e159-45b5-bdc7-8642785743ba None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:30.165647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080474ab-e159-45b5-bdc7-8642785743ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:30.166502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080474ab-e159-45b5-bdc7-8642785743ba None admin] RBAC: Adding query filter params (role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=fa2117a752a6470ba94633a048853441, user.id=8826568fb6d044389120182ed47b03a4) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:30.166813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080474ab-e159-45b5-bdc7-8642785743ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:30.168241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080474ab-e159-45b5-bdc7-8642785743ba None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:30.173676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 550/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:30 2022] GET /identity/v3/role_assignments?user.id=8826568fb6d044389120182ed47b03a4&scope.project.id=fa2117a752a6470ba94633a048853441&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:32.284183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c493a3-0a97-4d8c-9016-ab08437861bc None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.284734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c493a3-0a97-4d8c-9016-ab08437861bc None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.284734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c493a3-0a97-4d8c-9016-ab08437861bc None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.286088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 568/1118] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:32.291462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cd373-e5e1-4e5c-91d9-0ddea81ec6d1 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.291915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cd373-e5e1-4e5c-91d9-0ddea81ec6d1 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.292014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cd373-e5e1-4e5c-91d9-0ddea81ec6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.309100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-443cd373-e5e1-4e5c-91d9-0ddea81ec6d1 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:32.310307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-443cd373-e5e1-4e5c-91d9-0ddea81ec6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:32.379791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 551/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:32.403467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c493a3-0a97-4d8c-9016-ab08437861bc None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:32.475131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:32.512259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c493a3-0a97-4d8c-9016-ab08437861bc None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:32.548409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559552a0-e9e6-4fe5-9b02-6e111723ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:32.549407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559552a0-e9e6-4fe5-9b02-6e111723ad26 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.549737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559552a0-e9e6-4fe5-9b02-6e111723ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.550084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559552a0-e9e6-4fe5-9b02-6e111723ad26 None admin] PATH_INFO: `/v3/roles/85059d55a9ee403aa18b9580d26ccbed` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.551750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559552a0-e9e6-4fe5-9b02-6e111723ad26 None admin] RBAC: Authorizing `identity:get_role(role_id=85059d55a9ee403aa18b9580d26ccbed)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:32.553839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559552a0-e9e6-4fe5-9b02-6e111723ad26 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:32.555238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 569/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:32 2022] GET /identity/v3/roles/85059d55a9ee403aa18b9580d26ccbed => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:32.561274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cd373-e5e1-4e5c-91d9-0ddea81ec6d1 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:32.662511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cd373-e5e1-4e5c-91d9-0ddea81ec6d1 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:32.673755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:32.698427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3feec-fed5-42dd-93ff-647a662ad83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:32.699305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3feec-fed5-42dd-93ff-647a662ad83b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.699587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3feec-fed5-42dd-93ff-647a662ad83b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.699862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3feec-fed5-42dd-93ff-647a662ad83b None admin] PATH_INFO: `/v3/users/8826568fb6d044389120182ed47b03a4` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.701057 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3feec-fed5-42dd-93ff-647a662ad83b None admin] RBAC: Authorizing `identity:get_user(user_id=8826568fb6d044389120182ed47b03a4)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:32.702538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3feec-fed5-42dd-93ff-647a662ad83b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:32.704186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 552/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:32 2022] GET /identity/v3/users/8826568fb6d044389120182ed47b03a4 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:32.710062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559552a0-e9e6-4fe5-9b02-6e111723ad26 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:32.810616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559552a0-e9e6-4fe5-9b02-6e111723ad26 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:32.843361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db33c2-a6a8-43ef-bf39-59e2320305b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:32.844213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db33c2-a6a8-43ef-bf39-59e2320305b0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.844497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db33c2-a6a8-43ef-bf39-59e2320305b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.844775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db33c2-a6a8-43ef-bf39-59e2320305b0 None admin] PATH_INFO: `/v3/projects/fa2117a752a6470ba94633a048853441` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.845940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db33c2-a6a8-43ef-bf39-59e2320305b0 None admin] RBAC: Authorizing `identity:get_project(project_id=fa2117a752a6470ba94633a048853441)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:32.847405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db33c2-a6a8-43ef-bf39-59e2320305b0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:32.849621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 570/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:32 2022] GET /identity/v3/projects/fa2117a752a6470ba94633a048853441 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:32.856464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3feec-fed5-42dd-93ff-647a662ad83b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:32.958458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3feec-fed5-42dd-93ff-647a662ad83b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:32.993377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687baff-54fb-418f-a461-bf104eb6a75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:32.994256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687baff-54fb-418f-a461-bf104eb6a75f None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:32.994568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687baff-54fb-418f-a461-bf104eb6a75f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:32.994844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687baff-54fb-418f-a461-bf104eb6a75f None admin] PATH_INFO: `/v3/projects/fa2117a752a6470ba94633a048853441/users/8826568fb6d044389120182ed47b03a4/roles/85059d55a9ee403aa18b9580d26ccbed` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:32.997013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687baff-54fb-418f-a461-bf104eb6a75f None admin] RBAC: Authorizing `identity:create_grant(project_id=fa2117a752a6470ba94633a048853441, user_id=8826568fb6d044389120182ed47b03a4, role_id=85059d55a9ee403aa18b9580d26ccbed)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:32.998472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687baff-54fb-418f-a461-bf104eb6a75f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:33.011230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 553/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:38:32 2022] PUT /identity/v3/projects/fa2117a752a6470ba94633a048853441/users/8826568fb6d044389120182ed47b03a4/roles/85059d55a9ee403aa18b9580d26ccbed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:38:35.132055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9033b3-0cc3-4829-af0c-9d6ce7ced4a0 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.132608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9033b3-0cc3-4829-af0c-9d6ce7ced4a0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.132608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9033b3-0cc3-4829-af0c-9d6ce7ced4a0 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.133964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 571/1124] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:35.139147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5d39e-b629-4327-a6ac-ad01f355a607 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.139561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5d39e-b629-4327-a6ac-ad01f355a607 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.139695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5d39e-b629-4327-a6ac-ad01f355a607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.155697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f7e5d39e-b629-4327-a6ac-ad01f355a607 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:35.156864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f7e5d39e-b629-4327-a6ac-ad01f355a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:35.186883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:35.224386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 554/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:35.248004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9033b3-0cc3-4829-af0c-9d6ce7ced4a0 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:35.259960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:35.349628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9033b3-0cc3-4829-af0c-9d6ce7ced4a0 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:35.383504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df02bb-6f25-4d2f-a936-1bf2232e8a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:35.384277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df02bb-6f25-4d2f-a936-1bf2232e8a53 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.384561 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df02bb-6f25-4d2f-a936-1bf2232e8a53 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.384839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df02bb-6f25-4d2f-a936-1bf2232e8a53 None admin] PATH_INFO: `/v3/roles/85059d55a9ee403aa18b9580d26ccbed` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.386302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df02bb-6f25-4d2f-a936-1bf2232e8a53 None admin] RBAC: Authorizing `identity:get_role(role_id=85059d55a9ee403aa18b9580d26ccbed)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:35.387681 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df02bb-6f25-4d2f-a936-1bf2232e8a53 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:35.389050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 572/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:35 2022] GET /identity/v3/roles/85059d55a9ee403aa18b9580d26ccbed => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:35.394979 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5d39e-b629-4327-a6ac-ad01f355a607 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:35.491286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5d39e-b629-4327-a6ac-ad01f355a607 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:35.525269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbddd2-5106-4962-9037-cbc4eb7be6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:35.526140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbddd2-5106-4962-9037-cbc4eb7be6f6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.526447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbddd2-5106-4962-9037-cbc4eb7be6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.526722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbddd2-5106-4962-9037-cbc4eb7be6f6 None admin] PATH_INFO: `/v3/users/8826568fb6d044389120182ed47b03a4` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.527892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbddd2-5106-4962-9037-cbc4eb7be6f6 None admin] RBAC: Authorizing `identity:get_user(user_id=8826568fb6d044389120182ed47b03a4)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:35.529330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbddd2-5106-4962-9037-cbc4eb7be6f6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:35.530990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 555/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:35 2022] GET /identity/v3/users/8826568fb6d044389120182ed47b03a4 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:35.537468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df02bb-6f25-4d2f-a936-1bf2232e8a53 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:35.611910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:35.634421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df02bb-6f25-4d2f-a936-1bf2232e8a53 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:35.667700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08debbb-1996-46bb-b98a-5a664097d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:35.668345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08debbb-1996-46bb-b98a-5a664097d27e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.668625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08debbb-1996-46bb-b98a-5a664097d27e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.668899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08debbb-1996-46bb-b98a-5a664097d27e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.735749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08debbb-1996-46bb-b98a-5a664097d27e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:35.737181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08debbb-1996-46bb-b98a-5a664097d27e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:35.811866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:35.836300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 573/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:35.842447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbddd2-5106-4962-9037-cbc4eb7be6f6 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:35.876354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:35.941415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbddd2-5106-4962-9037-cbc4eb7be6f6 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:35.974990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959d355-40d1-48e9-9c49-79b7a50a6628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:35.975844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d355-40d1-48e9-9c49-79b7a50a6628 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:35.976123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d355-40d1-48e9-9c49-79b7a50a6628 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:35.976395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959d355-40d1-48e9-9c49-79b7a50a6628 None admin] PATH_INFO: `/v3/projects/fa2117a752a6470ba94633a048853441` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:35.977582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d355-40d1-48e9-9c49-79b7a50a6628 None admin] RBAC: Authorizing `identity:get_project(project_id=fa2117a752a6470ba94633a048853441)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:35.979044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959d355-40d1-48e9-9c49-79b7a50a6628 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:35.980755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 556/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:35 2022] GET /identity/v3/projects/fa2117a752a6470ba94633a048853441 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:35.986842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08debbb-1996-46bb-b98a-5a664097d27e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:36.084748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08debbb-1996-46bb-b98a-5a664097d27e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:36.119309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a62a05-c4a6-4b64-9fe6-76da153fdf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:36.119964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a62a05-c4a6-4b64-9fe6-76da153fdf20 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:36.120247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a62a05-c4a6-4b64-9fe6-76da153fdf20 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:36.120525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a62a05-c4a6-4b64-9fe6-76da153fdf20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:36.121349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a62a05-c4a6-4b64-9fe6-76da153fdf20 None admin] RBAC: Adding query filter params (role.id=85059d55a9ee403aa18b9580d26ccbed, scope.project.id=fa2117a752a6470ba94633a048853441, user.id=8826568fb6d044389120182ed47b03a4) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:36.121665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a62a05-c4a6-4b64-9fe6-76da153fdf20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:36.123115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a62a05-c4a6-4b64-9fe6-76da153fdf20 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:36.128883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 574/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:35 2022] GET /identity/v3/role_assignments?user.id=8826568fb6d044389120182ed47b03a4&scope.project.id=fa2117a752a6470ba94633a048853441&role.id=85059d55a9ee403aa18b9580d26ccbed => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:38.281471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4687118-a015-4c7d-be7d-0c215bdcc2df None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.282006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4687118-a015-4c7d-be7d-0c215bdcc2df None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.282006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4687118-a015-4c7d-be7d-0c215bdcc2df None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.283444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 557/1131] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:38.288630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877b27-bfc8-46f9-9606-a38599912cde None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.289058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877b27-bfc8-46f9-9606-a38599912cde None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.289187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877b27-bfc8-46f9-9606-a38599912cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.305810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-84877b27-bfc8-46f9-9606-a38599912cde None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:38.307049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-84877b27-bfc8-46f9-9606-a38599912cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:38.341696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:38.375859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 575/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:38.399466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4687118-a015-4c7d-be7d-0c215bdcc2df None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:38.503989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4687118-a015-4c7d-be7d-0c215bdcc2df None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:38.507072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:38.539604 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f7f85-f674-41ca-940b-50a4d77d8b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:38.540305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f7f85-f674-41ca-940b-50a4d77d8b4c None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.540584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f7f85-f674-41ca-940b-50a4d77d8b4c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.540854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f7f85-f674-41ca-940b-50a4d77d8b4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.542016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f7f85-f674-41ca-940b-50a4d77d8b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:38.543477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f7f85-f674-41ca-940b-50a4d77d8b4c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:38.545104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 558/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:38.551441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84877b27-bfc8-46f9-9606-a38599912cde None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:38.649571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84877b27-bfc8-46f9-9606-a38599912cde None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:38.682997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfd485-01cf-46eb-8dd4-1a7bdf71afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:38.683647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfd485-01cf-46eb-8dd4-1a7bdf71afa9 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:38.683928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfd485-01cf-46eb-8dd4-1a7bdf71afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:38.684207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfd485-01cf-46eb-8dd4-1a7bdf71afa9 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:38.684909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfd485-01cf-46eb-8dd4-1a7bdf71afa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:38.686340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfd485-01cf-46eb-8dd4-1a7bdf71afa9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:38.711880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 576/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:38 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:40.853989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ae61-c250-461f-9248-34f126a96fa5 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:40.854541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ae61-c250-461f-9248-34f126a96fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:40.854541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ae61-c250-461f-9248-34f126a96fa5 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:40.855882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 559/1135] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:40.861016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829254-973c-45bc-87c6-148dd756c5f2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:40.861423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829254-973c-45bc-87c6-148dd756c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:40.861586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829254-973c-45bc-87c6-148dd756c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:40.877906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-43829254-973c-45bc-87c6-148dd756c5f2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:40.879126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-43829254-973c-45bc-87c6-148dd756c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:40.895066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:40.946549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 577/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:40.972009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ae61-c250-461f-9248-34f126a96fa5 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:41.074616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ae61-c250-461f-9248-34f126a96fa5 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:41.108158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc819-67e9-45dd-a054-ead3641849f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:41.108863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc819-67e9-45dd-a054-ead3641849f6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:41.109143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc819-67e9-45dd-a054-ead3641849f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:41.109415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc819-67e9-45dd-a054-ead3641849f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:41.110631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc819-67e9-45dd-a054-ead3641849f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:41.112083 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc819-67e9-45dd-a054-ead3641849f6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:41.113694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 560/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:38:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:41.119613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43829254-973c-45bc-87c6-148dd756c5f2 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:41.217393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43829254-973c-45bc-87c6-148dd756c5f2 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:41.249968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62b156-5128-40e0-9b07-d14fa2031ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:41.250658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62b156-5128-40e0-9b07-d14fa2031ba8 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:41.250938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62b156-5128-40e0-9b07-d14fa2031ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:41.251350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62b156-5128-40e0-9b07-d14fa2031ba8 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:41.252047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62b156-5128-40e0-9b07-d14fa2031ba8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:41.253457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62b156-5128-40e0-9b07-d14fa2031ba8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:41.273644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 578/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:38:41 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:43.411988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8ffd3-febe-4718-ac20-9ee70ec6bdcd None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:43.412550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8ffd3-febe-4718-ac20-9ee70ec6bdcd None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:43.412550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8ffd3-febe-4718-ac20-9ee70ec6bdcd None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:43.413882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 561/1139] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:43.419104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db5da7-9e0e-4ba7-b39b-ceba213623ba None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:43.419506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db5da7-9e0e-4ba7-b39b-ceba213623ba None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:43.419668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db5da7-9e0e-4ba7-b39b-ceba213623ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:43.436980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b3db5da7-9e0e-4ba7-b39b-ceba213623ba None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:43.438169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b3db5da7-9e0e-4ba7-b39b-ceba213623ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:43.440397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:43.506207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 579/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:43.528925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8ffd3-febe-4718-ac20-9ee70ec6bdcd None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:43.572031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:43.630945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8ffd3-febe-4718-ac20-9ee70ec6bdcd None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:43.664121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cdce7-0a9b-412e-9613-b1fb8bc0111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:43.664830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cdce7-0a9b-412e-9613-b1fb8bc0111f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:43.665112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cdce7-0a9b-412e-9613-b1fb8bc0111f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:43.665385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cdce7-0a9b-412e-9613-b1fb8bc0111f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:43.676528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cdce7-0a9b-412e-9613-b1fb8bc0111f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-457cdce7-0a9b-412e-9613-b1fb8bc0111f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:43.684121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:43.685186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:43.691338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 562/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:43.692222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db5da7-9e0e-4ba7-b39b-ceba213623ba None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:43.789157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db5da7-9e0e-4ba7-b39b-ceba213623ba None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:43.822885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69a596-8393-47ba-9ead-d39d8e6d7ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:43.823577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a596-8393-47ba-9ead-d39d8e6d7ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:43.823861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a596-8393-47ba-9ead-d39d8e6d7ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:43.824137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a596-8393-47ba-9ead-d39d8e6d7ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:43.824909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69a596-8393-47ba-9ead-d39d8e6d7ac7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:43.825221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69a596-8393-47ba-9ead-d39d8e6d7ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:43.826668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69a596-8393-47ba-9ead-d39d8e6d7ac7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:43.832622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:43.841748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 580/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:43.843091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cdce7-0a9b-412e-9613-b1fb8bc0111f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:43.950296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:43.953326 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cdce7-0a9b-412e-9613-b1fb8bc0111f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:43.988527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de607a-9c45-4219-a401-48a9b62ae4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:43.989422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de607a-9c45-4219-a401-48a9b62ae4bb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:43.989697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de607a-9c45-4219-a401-48a9b62ae4bb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:43.989971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de607a-9c45-4219-a401-48a9b62ae4bb None admin] PATH_INFO: `/v3/users/34517f9e55ff40c28dfbe19453b96508` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:44.003606 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de607a-9c45-4219-a401-48a9b62ae4bb None admin] RBAC: Authorizing `identity:get_user(user_id=34517f9e55ff40c28dfbe19453b96508)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:44.005614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de607a-9c45-4219-a401-48a9b62ae4bb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:44.007367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 563/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:43 2022] GET /identity/v3/users/34517f9e55ff40c28dfbe19453b96508 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:44.013150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69a596-8393-47ba-9ead-d39d8e6d7ac7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:44.122154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69a596-8393-47ba-9ead-d39d8e6d7ac7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:44.158213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43126d5-6d4b-4402-97fb-2b95a603ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:44.158885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43126d5-6d4b-4402-97fb-2b95a603ac29 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:44.159166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43126d5-6d4b-4402-97fb-2b95a603ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:44.159441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43126d5-6d4b-4402-97fb-2b95a603ac29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:44.228799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:44.231208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43126d5-6d4b-4402-97fb-2b95a603ac29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:44.232704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43126d5-6d4b-4402-97fb-2b95a603ac29 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:44.338554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 581/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:44.344424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de607a-9c45-4219-a401-48a9b62ae4bb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:44.444755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de607a-9c45-4219-a401-48a9b62ae4bb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:44.478918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ffcd6-828b-4c2e-8fdd-2069bdfdba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:44.479693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ffcd6-828b-4c2e-8fdd-2069bdfdba66 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:44.479979 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ffcd6-828b-4c2e-8fdd-2069bdfdba66 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:44.480258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ffcd6-828b-4c2e-8fdd-2069bdfdba66 None admin] PATH_INFO: `/v3/projects/90dcecaa549b40ad887f18bacc085fbd` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:44.481458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ffcd6-828b-4c2e-8fdd-2069bdfdba66 None admin] RBAC: Authorizing `identity:get_project(project_id=90dcecaa549b40ad887f18bacc085fbd)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:44.482940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ffcd6-828b-4c2e-8fdd-2069bdfdba66 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:44.484655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 564/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:44 2022] GET /identity/v3/projects/90dcecaa549b40ad887f18bacc085fbd => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:44.491613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43126d5-6d4b-4402-97fb-2b95a603ac29 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:44.587727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:44.590663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43126d5-6d4b-4402-97fb-2b95a603ac29 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:44.624406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6523b3-bad4-4dca-a766-6e5dc5dc14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:44.625061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6523b3-bad4-4dca-a766-6e5dc5dc14eb None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:44.625344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6523b3-bad4-4dca-a766-6e5dc5dc14eb None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:44.625620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6523b3-bad4-4dca-a766-6e5dc5dc14eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:44.626488 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6523b3-bad4-4dca-a766-6e5dc5dc14eb None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=90dcecaa549b40ad887f18bacc085fbd, user.id=34517f9e55ff40c28dfbe19453b96508) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:44.626802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6523b3-bad4-4dca-a766-6e5dc5dc14eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:44.628222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6523b3-bad4-4dca-a766-6e5dc5dc14eb None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:44.634226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 582/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:44 2022] GET /identity/v3/role_assignments?user.id=34517f9e55ff40c28dfbe19453b96508&scope.project.id=90dcecaa549b40ad887f18bacc085fbd&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:46.748912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ae8e-6b69-4524-9e59-cd423bc87a19 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:46.749462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ae8e-6b69-4524-9e59-cd423bc87a19 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:46.749462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ae8e-6b69-4524-9e59-cd423bc87a19 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:46.750915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 565/1147] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:46.756204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde373ee-c9be-4ecf-ad42-ce3b5ffa507c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:46.756611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde373ee-c9be-4ecf-ad42-ce3b5ffa507c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:46.756700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde373ee-c9be-4ecf-ad42-ce3b5ffa507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:46.773654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-dde373ee-c9be-4ecf-ad42-ce3b5ffa507c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:46.774874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dde373ee-c9be-4ecf-ad42-ce3b5ffa507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:46.840644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 583/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:46.863599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ae8e-6b69-4524-9e59-cd423bc87a19 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:46.890349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:46.966219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ae8e-6b69-4524-9e59-cd423bc87a19 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:46.998812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93830776-2029-4082-8c6e-8e7fe6f78ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:46.999590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93830776-2029-4082-8c6e-8e7fe6f78ecf None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:46.999867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93830776-2029-4082-8c6e-8e7fe6f78ecf None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:47.000136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93830776-2029-4082-8c6e-8e7fe6f78ecf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:47.010422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93830776-2029-4082-8c6e-8e7fe6f78ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-93830776-2029-4082-8c6e-8e7fe6f78ecf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:47.017868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:47.018980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:47.019892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 566/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:47.025998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde373ee-c9be-4ecf-ad42-ce3b5ffa507c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:47.115632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:47.122459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde373ee-c9be-4ecf-ad42-ce3b5ffa507c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:47.156976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0904202-925b-461f-8d89-d4b4962f459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:47.157640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0904202-925b-461f-8d89-d4b4962f459f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:47.157924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0904202-925b-461f-8d89-d4b4962f459f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:47.158200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0904202-925b-461f-8d89-d4b4962f459f None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:47.158981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0904202-925b-461f-8d89-d4b4962f459f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:47.159290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0904202-925b-461f-8d89-d4b4962f459f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:47.160651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0904202-925b-461f-8d89-d4b4962f459f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:47.168627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 584/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:47.174589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93830776-2029-4082-8c6e-8e7fe6f78ecf None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:47.257831 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:47.273557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93830776-2029-4082-8c6e-8e7fe6f78ecf None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:47.305794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f20bc-2599-45d5-af9b-6712ab14d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:47.306686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f20bc-2599-45d5-af9b-6712ab14d27e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:47.306971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f20bc-2599-45d5-af9b-6712ab14d27e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:47.307246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f20bc-2599-45d5-af9b-6712ab14d27e None admin] PATH_INFO: `/v3/users/34517f9e55ff40c28dfbe19453b96508` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:47.308564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f20bc-2599-45d5-af9b-6712ab14d27e None admin] RBAC: Authorizing `identity:get_user(user_id=34517f9e55ff40c28dfbe19453b96508)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:47.309997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f20bc-2599-45d5-af9b-6712ab14d27e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:47.311732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 567/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:47 2022] GET /identity/v3/users/34517f9e55ff40c28dfbe19453b96508 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:38:47.318299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0904202-925b-461f-8d89-d4b4962f459f None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:47.415417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0904202-925b-461f-8d89-d4b4962f459f None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:47.448861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0f237-52f8-47a9-9fd9-90eb36caa694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:47.449707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0f237-52f8-47a9-9fd9-90eb36caa694 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:47.449988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0f237-52f8-47a9-9fd9-90eb36caa694 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:47.450264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0f237-52f8-47a9-9fd9-90eb36caa694 None admin] PATH_INFO: `/v3/projects/90dcecaa549b40ad887f18bacc085fbd` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:47.451461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0f237-52f8-47a9-9fd9-90eb36caa694 None admin] RBAC: Authorizing `identity:get_project(project_id=90dcecaa549b40ad887f18bacc085fbd)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:47.452887 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0f237-52f8-47a9-9fd9-90eb36caa694 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:47.454671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 585/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:47 2022] GET /identity/v3/projects/90dcecaa549b40ad887f18bacc085fbd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:47.460602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f20bc-2599-45d5-af9b-6712ab14d27e None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:47.562283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f20bc-2599-45d5-af9b-6712ab14d27e None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:47.595435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949eb0-f7c6-4fe8-907e-fb7a41f562aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:47.596317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949eb0-f7c6-4fe8-907e-fb7a41f562aa None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:47.596596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949eb0-f7c6-4fe8-907e-fb7a41f562aa None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:47.596867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949eb0-f7c6-4fe8-907e-fb7a41f562aa None admin] PATH_INFO: `/v3/projects/90dcecaa549b40ad887f18bacc085fbd/users/34517f9e55ff40c28dfbe19453b96508/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:47.598844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949eb0-f7c6-4fe8-907e-fb7a41f562aa None admin] RBAC: Authorizing `identity:create_grant(project_id=90dcecaa549b40ad887f18bacc085fbd, user_id=34517f9e55ff40c28dfbe19453b96508, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:47.600268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949eb0-f7c6-4fe8-907e-fb7a41f562aa None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:47.613404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 568/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:38:47 2022] PUT /identity/v3/projects/90dcecaa549b40ad887f18bacc085fbd/users/34517f9e55ff40c28dfbe19453b96508/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:38:49.700927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575a377-112b-4055-9f63-afb713b1dd32 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:49.701487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575a377-112b-4055-9f63-afb713b1dd32 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:49.701487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575a377-112b-4055-9f63-afb713b1dd32 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:49.702902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 586/1154] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:49.707968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cb54b-2cc4-4498-bb0d-8bea87189f13 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:49.708349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cb54b-2cc4-4498-bb0d-8bea87189f13 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:49.708571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cb54b-2cc4-4498-bb0d-8bea87189f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:49.725991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-003cb54b-2cc4-4498-bb0d-8bea87189f13 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:49.727214 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-003cb54b-2cc4-4498-bb0d-8bea87189f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:49.736589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:49.792618 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 569/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:49.816206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575a377-112b-4055-9f63-afb713b1dd32 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:49.844348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:49.922848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575a377-112b-4055-9f63-afb713b1dd32 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:49.956048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6a781-ead8-41c3-addf-852678b9d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:49.956838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6a781-ead8-41c3-addf-852678b9d906 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:49.957122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6a781-ead8-41c3-addf-852678b9d906 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:49.957401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6a781-ead8-41c3-addf-852678b9d906 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:49.967973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6a781-ead8-41c3-addf-852678b9d906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e5a6a781-ead8-41c3-addf-852678b9d906 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:38:49.976182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:49.977259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:38:49.978302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 587/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:49.983595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cb54b-2cc4-4498-bb0d-8bea87189f13 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:50.079997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cb54b-2cc4-4498-bb0d-8bea87189f13 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:50.114668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ff2be-1ce7-4399-8d95-7e7f23b3ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:50.115842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ff2be-1ce7-4399-8d95-7e7f23b3ecad None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:50.116119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ff2be-1ce7-4399-8d95-7e7f23b3ecad None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:50.116392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ff2be-1ce7-4399-8d95-7e7f23b3ecad None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:50.117128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ff2be-1ce7-4399-8d95-7e7f23b3ecad None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:50.117431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ff2be-1ce7-4399-8d95-7e7f23b3ecad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:50.118823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ff2be-1ce7-4399-8d95-7e7f23b3ecad None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:50.126829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 570/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:50.132719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6a781-ead8-41c3-addf-852678b9d906 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:50.215132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:50.231345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6a781-ead8-41c3-addf-852678b9d906 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:50.264538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01c3ff-b3e1-429e-8805-c4ec442158ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:50.265406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01c3ff-b3e1-429e-8805-c4ec442158ea None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:50.265691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01c3ff-b3e1-429e-8805-c4ec442158ea None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:50.265969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01c3ff-b3e1-429e-8805-c4ec442158ea None admin] PATH_INFO: `/v3/users/34517f9e55ff40c28dfbe19453b96508` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:50.267195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01c3ff-b3e1-429e-8805-c4ec442158ea None admin] RBAC: Authorizing `identity:get_user(user_id=34517f9e55ff40c28dfbe19453b96508)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:50.268640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01c3ff-b3e1-429e-8805-c4ec442158ea None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:50.270267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 588/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:38:50 2022] GET /identity/v3/users/34517f9e55ff40c28dfbe19453b96508 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:50.276097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ff2be-1ce7-4399-8d95-7e7f23b3ecad None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:50.285405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:50.376867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ff2be-1ce7-4399-8d95-7e7f23b3ecad None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:50.409757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c55789-5bed-4fac-a967-522cc5bd7318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:50.410420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55789-5bed-4fac-a967-522cc5bd7318 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:50.410707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55789-5bed-4fac-a967-522cc5bd7318 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:50.410982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55789-5bed-4fac-a967-522cc5bd7318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:50.477196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c55789-5bed-4fac-a967-522cc5bd7318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:50.478666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c55789-5bed-4fac-a967-522cc5bd7318 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:50.486308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:50.574690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 571/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:50.580584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01c3ff-b3e1-429e-8805-c4ec442158ea None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:50.678353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01c3ff-b3e1-429e-8805-c4ec442158ea None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:50.710659 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092490f0-8444-49d0-9444-59d74937dfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:50.711506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092490f0-8444-49d0-9444-59d74937dfe8 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:50.711787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092490f0-8444-49d0-9444-59d74937dfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:50.712060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092490f0-8444-49d0-9444-59d74937dfe8 None admin] PATH_INFO: `/v3/projects/90dcecaa549b40ad887f18bacc085fbd` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:50.713213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092490f0-8444-49d0-9444-59d74937dfe8 None admin] RBAC: Authorizing `identity:get_project(project_id=90dcecaa549b40ad887f18bacc085fbd)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:50.714647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092490f0-8444-49d0-9444-59d74937dfe8 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:50.716320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 589/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:38:50 2022] GET /identity/v3/projects/90dcecaa549b40ad887f18bacc085fbd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:50.722489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c55789-5bed-4fac-a967-522cc5bd7318 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:50.821084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c55789-5bed-4fac-a967-522cc5bd7318 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:50.828566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:50.855452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11959ec2-2dda-4923-bb00-67ddfa26264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:50.856103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11959ec2-2dda-4923-bb00-67ddfa26264f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:50.856386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11959ec2-2dda-4923-bb00-67ddfa26264f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:50.856659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11959ec2-2dda-4923-bb00-67ddfa26264f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:50.857520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11959ec2-2dda-4923-bb00-67ddfa26264f None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=90dcecaa549b40ad887f18bacc085fbd, user.id=34517f9e55ff40c28dfbe19453b96508) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:50.857833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11959ec2-2dda-4923-bb00-67ddfa26264f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:50.859291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11959ec2-2dda-4923-bb00-67ddfa26264f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:50.865259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 572/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:38:50 2022] GET /identity/v3/role_assignments?user.id=34517f9e55ff40c28dfbe19453b96508&scope.project.id=90dcecaa549b40ad887f18bacc085fbd&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:53.018811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c9a0-ffcd-4cf6-bf3c-b4de62f79fb1 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:53.019370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c9a0-ffcd-4cf6-bf3c-b4de62f79fb1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:53.019370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c9a0-ffcd-4cf6-bf3c-b4de62f79fb1 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:53.020722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 590/1162] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:53.026493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc53aee-0773-4465-b538-4f6731db30f4 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:53.026884 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc53aee-0773-4465-b538-4f6731db30f4 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:53.027046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc53aee-0773-4465-b538-4f6731db30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:53.043738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ebc53aee-0773-4465-b538-4f6731db30f4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:53.044926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ebc53aee-0773-4465-b538-4f6731db30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:53.111128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 573/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:38:53.133754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0c9a0-ffcd-4cf6-bf3c-b4de62f79fb1 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:53.155869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:53.232277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0c9a0-ffcd-4cf6-bf3c-b4de62f79fb1 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:53.264464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2149e9-826b-4519-86a4-a371ec0c7370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:53.265098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2149e9-826b-4519-86a4-a371ec0c7370 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:53.265386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2149e9-826b-4519-86a4-a371ec0c7370 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:53.265660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2149e9-826b-4519-86a4-a371ec0c7370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:53.330952 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2149e9-826b-4519-86a4-a371ec0c7370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:53.332296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2149e9-826b-4519-86a4-a371ec0c7370 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:53.352684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:53.429615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 591/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:38:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:38:53.435555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc53aee-0773-4465-b538-4f6731db30f4 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:53.531497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:53.534685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc53aee-0773-4465-b538-4f6731db30f4 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:53.569133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9f433-7651-40f4-a3f7-1532880e8a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:53.569925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9f433-7651-40f4-a3f7-1532880e8a52 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:53.570208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9f433-7651-40f4-a3f7-1532880e8a52 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:53.570516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9f433-7651-40f4-a3f7-1532880e8a52 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:53.577099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9f433-7651-40f4-a3f7-1532880e8a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:53.578564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9f433-7651-40f4-a3f7-1532880e8a52 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-f3e9f433-7651-40f4-a3f7-1532880e8a52 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:38:53.592485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:38:53.593652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:38:53.594733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 574/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:38:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:38:53.599581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2149e9-826b-4519-86a4-a371ec0c7370 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:53.695528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2149e9-826b-4519-86a4-a371ec0c7370 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:53.714999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:53.729307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bf483-9e98-4c40-8ae4-9640c8c6f0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:53.729972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bf483-9e98-4c40-8ae4-9640c8c6f0a1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:53.730260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bf483-9e98-4c40-8ae4-9640c8c6f0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:53.730574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bf483-9e98-4c40-8ae4-9640c8c6f0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:53.731299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bf483-9e98-4c40-8ae4-9640c8c6f0a1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:38:53.731611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bf483-9e98-4c40-8ae4-9640c8c6f0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:53.732967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bf483-9e98-4c40-8ae4-9640c8c6f0a1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:53.740784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 592/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jun 16 18:38:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:55.841330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c87d1-fbd8-4787-91a5-be0cb980df6f None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:55.841879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c87d1-fbd8-4787-91a5-be0cb980df6f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:55.841879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c87d1-fbd8-4787-91a5-be0cb980df6f None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:55.843235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 575/1167] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:55.849129 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b323f-3af7-43a2-80df-d18a20a5dac9 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:55.849686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b323f-3af7-43a2-80df-d18a20a5dac9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:55.849686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b323f-3af7-43a2-80df-d18a20a5dac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:55.867853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-c31b323f-3af7-43a2-80df-d18a20a5dac9 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:55.869049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c31b323f-3af7-43a2-80df-d18a20a5dac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:55.939751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 593/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:55.963261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c87d1-fbd8-4787-91a5-be0cb980df6f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:56.063228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c87d1-fbd8-4787-91a5-be0cb980df6f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:56.097023 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d9f70-d54c-4143-9c89-40799c2d736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:56.097603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9f70-d54c-4143-9c89-40799c2d736c None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:56.097884 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9f70-d54c-4143-9c89-40799c2d736c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:56.098160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9f70-d54c-4143-9c89-40799c2d736c None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:56.099455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d9f70-d54c-4143-9c89-40799c2d736c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:56.100816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d9f70-d54c-4143-9c89-40799c2d736c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:56.116910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 576/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Thu Jun 16 18:38:55 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:38:58.253353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deef3af-3621-403d-8281-8d59f01730a8 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:58.253925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deef3af-3621-403d-8281-8d59f01730a8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:58.253925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deef3af-3621-403d-8281-8d59f01730a8 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:58.255815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 594/1170] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:38:58.260916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f734-f4a7-4a18-9151-708c853f252d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:58.261353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f734-f4a7-4a18-9151-708c853f252d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:58.261464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961f734-f4a7-4a18-9151-708c853f252d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:58.278700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d961f734-f4a7-4a18-9151-708c853f252d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:38:58.279893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d961f734-f4a7-4a18-9151-708c853f252d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:38:58.293626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:58.346558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 577/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:38:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:38:58.369774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deef3af-3621-403d-8281-8d59f01730a8 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:58.469753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deef3af-3621-403d-8281-8d59f01730a8 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:58.483678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:58.503913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a700a-c267-4679-95a6-0314d11d711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:58.504707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a700a-c267-4679-95a6-0314d11d711a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:58.504991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a700a-c267-4679-95a6-0314d11d711a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:58.505775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a700a-c267-4679-95a6-0314d11d711a None admin] PATH_INFO: `/v3/domains/cc0f05fbc902401682adaf725f24e657` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:58.516474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a700a-c267-4679-95a6-0314d11d711a None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc0f05fbc902401682adaf725f24e657)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:58.517903 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a700a-c267-4679-95a6-0314d11d711a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:58.519589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 595/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Thu Jun 16 18:38:58 2022] GET /identity/v3/domains/cc0f05fbc902401682adaf725f24e657 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:38:58.525982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961f734-f4a7-4a18-9151-708c853f252d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:38:58.622553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961f734-f4a7-4a18-9151-708c853f252d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:38:58.655788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdb409-9f12-41a7-945a-260bc12d7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:38:58.656442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdb409-9f12-41a7-945a-260bc12d7502 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:38:58.656726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdb409-9f12-41a7-945a-260bc12d7502 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:38:58.657002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdb409-9f12-41a7-945a-260bc12d7502 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:38:58.657718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdb409-9f12-41a7-945a-260bc12d7502 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:38:58.659176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdb409-9f12-41a7-945a-260bc12d7502 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:38:58.683997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 578/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:38:58 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:39:00.821275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fc553-fa66-436d-b390-9b8ede9e745d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:00.821796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fc553-fa66-436d-b390-9b8ede9e745d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:00.821796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fc553-fa66-436d-b390-9b8ede9e745d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:00.823123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 596/1174] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:00.828433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67903ed4-a8db-4327-a811-6714d6693d31 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:00.828870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67903ed4-a8db-4327-a811-6714d6693d31 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:00.828994 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67903ed4-a8db-4327-a811-6714d6693d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:00.834641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:00.848030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-67903ed4-a8db-4327-a811-6714d6693d31 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:00.849236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-67903ed4-a8db-4327-a811-6714d6693d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:00.915404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 579/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:00.941133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fc553-fa66-436d-b390-9b8ede9e745d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:01.041396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fc553-fa66-436d-b390-9b8ede9e745d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:01.077454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862832e3-03a9-41e9-b010-77a23a2f0733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:01.078245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862832e3-03a9-41e9-b010-77a23a2f0733 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:01.078572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862832e3-03a9-41e9-b010-77a23a2f0733 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:01.078856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862832e3-03a9-41e9-b010-77a23a2f0733 None admin] PATH_INFO: `/v3/domains/cc0f05fbc902401682adaf725f24e657` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:01.080037 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862832e3-03a9-41e9-b010-77a23a2f0733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc0f05fbc902401682adaf725f24e657)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:01.081467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862832e3-03a9-41e9-b010-77a23a2f0733 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:01.083325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 597/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Thu Jun 16 18:39:00 2022] GET /identity/v3/domains/cc0f05fbc902401682adaf725f24e657 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:01.089099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67903ed4-a8db-4327-a811-6714d6693d31 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:01.186520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67903ed4-a8db-4327-a811-6714d6693d31 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:01.216264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:01.221712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c70a8-a169-4907-ad99-2967d479b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:01.222406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c70a8-a169-4907-ad99-2967d479b70e None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:01.222687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c70a8-a169-4907-ad99-2967d479b70e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:01.222961 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c70a8-a169-4907-ad99-2967d479b70e None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:01.223665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c70a8-a169-4907-ad99-2967d479b70e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:01.225623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c70a8-a169-4907-ad99-2967d479b70e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:01.245604 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 580/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:39:01 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:39:03.402172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e9506-6362-4ca5-829d-cfed017ab5bf None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:03.402740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e9506-6362-4ca5-829d-cfed017ab5bf None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:03.402740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e9506-6362-4ca5-829d-cfed017ab5bf None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:03.404096 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 598/1178] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:03.409286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68eefc-222e-4f43-87ca-7fb992a12ff2 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:03.409698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68eefc-222e-4f43-87ca-7fb992a12ff2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:03.409829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68eefc-222e-4f43-87ca-7fb992a12ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:03.427456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ac68eefc-222e-4f43-87ca-7fb992a12ff2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:03.428621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ac68eefc-222e-4f43-87ca-7fb992a12ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:03.494629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 581/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:03.517829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e9506-6362-4ca5-829d-cfed017ab5bf None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:03.565673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:03.622525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e9506-6362-4ca5-829d-cfed017ab5bf None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:03.654977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676904f-e7b0-4af1-b2c8-e10fba6a9fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:03.655690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676904f-e7b0-4af1-b2c8-e10fba6a9fc4 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:03.655969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676904f-e7b0-4af1-b2c8-e10fba6a9fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:03.656239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676904f-e7b0-4af1-b2c8-e10fba6a9fc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:03.666802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676904f-e7b0-4af1-b2c8-e10fba6a9fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-c676904f-e7b0-4af1-b2c8-e10fba6a9fc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:39:03.674213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:39:03.675418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:39:03.676522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 599/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:39:03.681947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68eefc-222e-4f43-87ca-7fb992a12ff2 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:03.783313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68eefc-222e-4f43-87ca-7fb992a12ff2 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:03.801119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:03.820513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a549684-87f6-46aa-a846-61b582ed65b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:03.821185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a549684-87f6-46aa-a846-61b582ed65b9 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:03.821469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a549684-87f6-46aa-a846-61b582ed65b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:03.821741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a549684-87f6-46aa-a846-61b582ed65b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:03.822523 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a549684-87f6-46aa-a846-61b582ed65b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:03.822828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a549684-87f6-46aa-a846-61b582ed65b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:03.824212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a549684-87f6-46aa-a846-61b582ed65b9 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:03.833804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 582/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:03.839704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676904f-e7b0-4af1-b2c8-e10fba6a9fc4 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:03.940367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676904f-e7b0-4af1-b2c8-e10fba6a9fc4 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:03.941799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:03.973064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da595914-73be-4881-96a8-c61938164e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:03.973965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da595914-73be-4881-96a8-c61938164e74 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:03.974245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da595914-73be-4881-96a8-c61938164e74 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:03.974546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da595914-73be-4881-96a8-c61938164e74 None admin] PATH_INFO: `/v3/users/f42cb417ebbc46cb9583f4bccaaa12e0` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:03.987444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da595914-73be-4881-96a8-c61938164e74 None admin] RBAC: Authorizing `identity:get_user(user_id=f42cb417ebbc46cb9583f4bccaaa12e0)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:03.988878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da595914-73be-4881-96a8-c61938164e74 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:03.991161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 600/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:39:03 2022] GET /identity/v3/users/f42cb417ebbc46cb9583f4bccaaa12e0 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:03.997187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a549684-87f6-46aa-a846-61b582ed65b9 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:04.104216 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a549684-87f6-46aa-a846-61b582ed65b9 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:04.140643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcfbf0-17b7-4f09-9df8-344c9b1754a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:04.141291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcfbf0-17b7-4f09-9df8-344c9b1754a0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:04.141576 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcfbf0-17b7-4f09-9df8-344c9b1754a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:04.141851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcfbf0-17b7-4f09-9df8-344c9b1754a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:04.191924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:04.212468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcfbf0-17b7-4f09-9df8-344c9b1754a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:04.213940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcfbf0-17b7-4f09-9df8-344c9b1754a0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:04.310583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 583/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:39:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:39:04.316722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da595914-73be-4881-96a8-c61938164e74 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:04.414440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da595914-73be-4881-96a8-c61938164e74 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:04.450952 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394d1b7-b2ab-4be0-9ff8-c456e63bec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:04.451740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394d1b7-b2ab-4be0-9ff8-c456e63bec1f None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:04.452022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394d1b7-b2ab-4be0-9ff8-c456e63bec1f None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:04.452299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394d1b7-b2ab-4be0-9ff8-c456e63bec1f None admin] PATH_INFO: `/v3/projects/5ec8621d9f874d628769c76caa7553b1` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:04.453491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394d1b7-b2ab-4be0-9ff8-c456e63bec1f None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8621d9f874d628769c76caa7553b1)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:04.454941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394d1b7-b2ab-4be0-9ff8-c456e63bec1f None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:04.456641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 601/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:39:04 2022] GET /identity/v3/projects/5ec8621d9f874d628769c76caa7553b1 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:04.463399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcfbf0-17b7-4f09-9df8-344c9b1754a0 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:04.557506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:04.577689 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcfbf0-17b7-4f09-9df8-344c9b1754a0 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:04.616020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c232d-7df5-411f-898e-2c82774fb445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:04.616677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c232d-7df5-411f-898e-2c82774fb445 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:04.616960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c232d-7df5-411f-898e-2c82774fb445 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:04.617235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c232d-7df5-411f-898e-2c82774fb445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:04.618061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c232d-7df5-411f-898e-2c82774fb445 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=5ec8621d9f874d628769c76caa7553b1, user.id=f42cb417ebbc46cb9583f4bccaaa12e0) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:04.618373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c232d-7df5-411f-898e-2c82774fb445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:04.619826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c232d-7df5-411f-898e-2c82774fb445 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:04.625330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 584/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:39:04 2022] GET /identity/v3/role_assignments?user.id=f42cb417ebbc46cb9583f4bccaaa12e0&scope.project.id=5ec8621d9f874d628769c76caa7553b1&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:06.725579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff74e1-e66e-4af6-8eee-1b195d1bcd73 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:06.726207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff74e1-e66e-4af6-8eee-1b195d1bcd73 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:06.726207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff74e1-e66e-4af6-8eee-1b195d1bcd73 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:06.727543 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 602/1186] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:06.733885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b13bf4-b91d-42a3-a1c9-ac141ffb76af None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:06.734364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b13bf4-b91d-42a3-a1c9-ac141ffb76af None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:06.734859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b13bf4-b91d-42a3-a1c9-ac141ffb76af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:06.762752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e5b13bf4-b91d-42a3-a1c9-ac141ffb76af None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:06.764654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e5b13bf4-b91d-42a3-a1c9-ac141ffb76af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:06.874802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 585/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:06.897604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff74e1-e66e-4af6-8eee-1b195d1bcd73 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:06.924951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:07.004703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff74e1-e66e-4af6-8eee-1b195d1bcd73 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:07.038297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9bb99-9622-4d4c-9782-57fca0dfec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:07.039033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9bb99-9622-4d4c-9782-57fca0dfec07 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:07.039312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9bb99-9622-4d4c-9782-57fca0dfec07 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:07.039586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9bb99-9622-4d4c-9782-57fca0dfec07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:07.049871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9bb99-9622-4d4c-9782-57fca0dfec07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-32b9bb99-9622-4d4c-9782-57fca0dfec07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:39:07.057423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:39:07.058559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:39:07.059734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 603/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:39:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:39:07.065139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b13bf4-b91d-42a3-a1c9-ac141ffb76af None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:07.138863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:07.164148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b13bf4-b91d-42a3-a1c9-ac141ffb76af None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:07.197399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69249893-d345-42aa-8906-aca276cac5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:07.198067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69249893-d345-42aa-8906-aca276cac5e0 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:07.198349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69249893-d345-42aa-8906-aca276cac5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:07.198655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69249893-d345-42aa-8906-aca276cac5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:07.199404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69249893-d345-42aa-8906-aca276cac5e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:07.199711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69249893-d345-42aa-8906-aca276cac5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:07.201084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69249893-d345-42aa-8906-aca276cac5e0 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:07.210064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 586/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:07.215867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9bb99-9622-4d4c-9782-57fca0dfec07 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:07.303740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:07.316166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9bb99-9622-4d4c-9782-57fca0dfec07 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:07.350247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ca55c-650f-46ea-9e25-a413bbdbae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:07.351155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ca55c-650f-46ea-9e25-a413bbdbae3d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:07.351440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ca55c-650f-46ea-9e25-a413bbdbae3d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:07.351724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ca55c-650f-46ea-9e25-a413bbdbae3d None admin] PATH_INFO: `/v3/users/f42cb417ebbc46cb9583f4bccaaa12e0` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:07.352917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ca55c-650f-46ea-9e25-a413bbdbae3d None admin] RBAC: Authorizing `identity:get_user(user_id=f42cb417ebbc46cb9583f4bccaaa12e0)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:07.354343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ca55c-650f-46ea-9e25-a413bbdbae3d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:07.356025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 604/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:39:07 2022] GET /identity/v3/users/f42cb417ebbc46cb9583f4bccaaa12e0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:07.361832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69249893-d345-42aa-8906-aca276cac5e0 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:07.460767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69249893-d345-42aa-8906-aca276cac5e0 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:07.493103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0c316-d641-43d0-a45f-ee70d7e12303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:07.493953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0c316-d641-43d0-a45f-ee70d7e12303 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:07.494238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0c316-d641-43d0-a45f-ee70d7e12303 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:07.494543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0c316-d641-43d0-a45f-ee70d7e12303 None admin] PATH_INFO: `/v3/projects/5ec8621d9f874d628769c76caa7553b1` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:07.495721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0c316-d641-43d0-a45f-ee70d7e12303 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8621d9f874d628769c76caa7553b1)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:07.497175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0c316-d641-43d0-a45f-ee70d7e12303 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:07.498931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 587/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:39:07 2022] GET /identity/v3/projects/5ec8621d9f874d628769c76caa7553b1 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:07.504950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ca55c-650f-46ea-9e25-a413bbdbae3d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:07.604911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ca55c-650f-46ea-9e25-a413bbdbae3d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:07.637931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733bde8-8860-41ce-9854-b0c5710a9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:07.638845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bde8-8860-41ce-9854-b0c5710a9884 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:07.639132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bde8-8860-41ce-9854-b0c5710a9884 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:07.639413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bde8-8860-41ce-9854-b0c5710a9884 None admin] PATH_INFO: `/v3/projects/5ec8621d9f874d628769c76caa7553b1/users/f42cb417ebbc46cb9583f4bccaaa12e0/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:07.641400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733bde8-8860-41ce-9854-b0c5710a9884 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec8621d9f874d628769c76caa7553b1, user_id=f42cb417ebbc46cb9583f4bccaaa12e0, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:07.642862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733bde8-8860-41ce-9854-b0c5710a9884 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:07.656147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 605/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:39:07 2022] PUT /identity/v3/projects/5ec8621d9f874d628769c76caa7553b1/users/f42cb417ebbc46cb9583f4bccaaa12e0/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:39:09.760741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3755d-52f6-4e12-82d2-ec4b2c723a1b None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:09.761250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3755d-52f6-4e12-82d2-ec4b2c723a1b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:09.761250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3755d-52f6-4e12-82d2-ec4b2c723a1b None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:09.762609 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 588/1193] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:39:09.767708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198eee-cc56-4a56-ba4d-1aed040a620e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:09.768155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198eee-cc56-4a56-ba4d-1aed040a620e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:09.768249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198eee-cc56-4a56-ba4d-1aed040a620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:09.785023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5e198eee-cc56-4a56-ba4d-1aed040a620e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:39:09.786185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5e198eee-cc56-4a56-ba4d-1aed040a620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:39:09.796567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:09.852453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 606/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:39:09.876259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3755d-52f6-4e12-82d2-ec4b2c723a1b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:09.880731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:09.977001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3755d-52f6-4e12-82d2-ec4b2c723a1b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:10.011075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a065173-89cc-437a-878e-93b7795dfd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:10.011776 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065173-89cc-437a-878e-93b7795dfd64 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:10.012058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065173-89cc-437a-878e-93b7795dfd64 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:10.012333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065173-89cc-437a-878e-93b7795dfd64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:10.022828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a065173-89cc-437a-878e-93b7795dfd64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-9a065173-89cc-437a-878e-93b7795dfd64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:39:10.030287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:39:10.031414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:39:10.032462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 589/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:39:10.037570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e198eee-cc56-4a56-ba4d-1aed040a620e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:10.135275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e198eee-cc56-4a56-ba4d-1aed040a620e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:10.167502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5e9bf-ae1c-4696-a2f2-f87a328c211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:10.168157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5e9bf-ae1c-4696-a2f2-f87a328c211e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:10.168442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5e9bf-ae1c-4696-a2f2-f87a328c211e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:10.168719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5e9bf-ae1c-4696-a2f2-f87a328c211e None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:10.169457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5e9bf-ae1c-4696-a2f2-f87a328c211e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:10.169764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5e9bf-ae1c-4696-a2f2-f87a328c211e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:10.171162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5e9bf-ae1c-4696-a2f2-f87a328c211e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:10.179488 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 607/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:10.185369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a065173-89cc-437a-878e-93b7795dfd64 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:10.246238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:10.282358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a065173-89cc-437a-878e-93b7795dfd64 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:10.317378 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030bd86-b98d-4bd5-8bc7-1c5abafa22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:10.318818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030bd86-b98d-4bd5-8bc7-1c5abafa22ed None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:10.319097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030bd86-b98d-4bd5-8bc7-1c5abafa22ed None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:10.319364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030bd86-b98d-4bd5-8bc7-1c5abafa22ed None admin] PATH_INFO: `/v3/users/f42cb417ebbc46cb9583f4bccaaa12e0` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:10.320545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030bd86-b98d-4bd5-8bc7-1c5abafa22ed None admin] RBAC: Authorizing `identity:get_user(user_id=f42cb417ebbc46cb9583f4bccaaa12e0)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:10.321967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030bd86-b98d-4bd5-8bc7-1c5abafa22ed None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:10.323620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 590/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jun 16 18:39:10 2022] GET /identity/v3/users/f42cb417ebbc46cb9583f4bccaaa12e0 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:10.329344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5e9bf-ae1c-4696-a2f2-f87a328c211e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:10.341007 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:10.427902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5e9bf-ae1c-4696-a2f2-f87a328c211e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:10.461054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eab31-5383-4fe3-928c-614d01254c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:10.461697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eab31-5383-4fe3-928c-614d01254c6a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:10.461981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eab31-5383-4fe3-928c-614d01254c6a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:10.462257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062eab31-5383-4fe3-928c-614d01254c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:10.534461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062eab31-5383-4fe3-928c-614d01254c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:10.535843 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062eab31-5383-4fe3-928c-614d01254c6a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:10.545758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:10.631679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 608/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:39:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:39:10.637662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030bd86-b98d-4bd5-8bc7-1c5abafa22ed None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:10.734442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030bd86-b98d-4bd5-8bc7-1c5abafa22ed None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:10.763125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:10.768455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804a8b-513b-4fd9-adfa-735c31fa1b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:10.769301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804a8b-513b-4fd9-adfa-735c31fa1b58 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:10.769577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804a8b-513b-4fd9-adfa-735c31fa1b58 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:10.769845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804a8b-513b-4fd9-adfa-735c31fa1b58 None admin] PATH_INFO: `/v3/projects/5ec8621d9f874d628769c76caa7553b1` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:10.771575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82804a8b-513b-4fd9-adfa-735c31fa1b58 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec8621d9f874d628769c76caa7553b1)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:10.772982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82804a8b-513b-4fd9-adfa-735c31fa1b58 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:10.774667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 591/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jun 16 18:39:10 2022] GET /identity/v3/projects/5ec8621d9f874d628769c76caa7553b1 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:10.780880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eab31-5383-4fe3-928c-614d01254c6a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:39:10.879929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062eab31-5383-4fe3-928c-614d01254c6a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:39:10.888800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:10.915942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022d2e8-d00a-4a79-a9e3-731e67818796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:39:10.916593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d2e8-d00a-4a79-a9e3-731e67818796 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:39:10.916894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d2e8-d00a-4a79-a9e3-731e67818796 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:39:10.917156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d2e8-d00a-4a79-a9e3-731e67818796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:39:10.917987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022d2e8-d00a-4a79-a9e3-731e67818796 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=5ec8621d9f874d628769c76caa7553b1, user.id=f42cb417ebbc46cb9583f4bccaaa12e0) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:39:10.918299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022d2e8-d00a-4a79-a9e3-731e67818796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:39:10.919743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022d2e8-d00a-4a79-a9e3-731e67818796 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:39:10.925560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 609/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:39:10 2022] GET /identity/v3/role_assignments?user.id=f42cb417ebbc46cb9583f4bccaaa12e0&scope.project.id=5ec8621d9f874d628769c76caa7553b1&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:39:20.922980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=14 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:07.393371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c37d1b-cbee-4016-be42-8b89d7f4e715 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:07.393984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c37d1b-cbee-4016-be42-8b89d7f4e715 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:07.393984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c37d1b-cbee-4016-be42-8b89d7f4e715 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:07.395932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 592/1201] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:07.401392 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0dbf8-6911-4b5e-8149-5103db724fb8 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:07.401851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0dbf8-6911-4b5e-8149-5103db724fb8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:07.401951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0dbf8-6911-4b5e-8149-5103db724fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:07.420930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-39a0dbf8-6911-4b5e-8149-5103db724fb8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:07.422191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-39a0dbf8-6911-4b5e-8149-5103db724fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:07.510786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 610/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:07.536621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c37d1b-cbee-4016-be42-8b89d7f4e715 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:07.662960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c37d1b-cbee-4016-be42-8b89d7f4e715 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:07.705460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282461ba-12a8-4373-93f3-9f06f0b8ad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:07.706300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282461ba-12a8-4373-93f3-9f06f0b8ad35 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:07.706589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282461ba-12a8-4373-93f3-9f06f0b8ad35 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:07.706870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282461ba-12a8-4373-93f3-9f06f0b8ad35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:07.718407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282461ba-12a8-4373-93f3-9f06f0b8ad35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:07.719870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282461ba-12a8-4373-93f3-9f06f0b8ad35 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-282461ba-12a8-4373-93f3-9f06f0b8ad35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:07.739648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:07.740730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:07.741737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:07.741737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:07.741737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:07.741737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:07.749158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 593/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:07.749360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0dbf8-6911-4b5e-8149-5103db724fb8 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:07.868795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0dbf8-6911-4b5e-8149-5103db724fb8 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:07.901828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:07.910111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36046415-584c-4167-95b1-5c2d00705b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:07.910934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36046415-584c-4167-95b1-5c2d00705b59 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:07.911396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36046415-584c-4167-95b1-5c2d00705b59 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:07.911923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36046415-584c-4167-95b1-5c2d00705b59 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:07.913086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36046415-584c-4167-95b1-5c2d00705b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:07.913501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36046415-584c-4167-95b1-5c2d00705b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:07.915005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36046415-584c-4167-95b1-5c2d00705b59 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:07.929764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 611/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:40:07.935478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282461ba-12a8-4373-93f3-9f06f0b8ad35 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:07.998528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:08.059700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282461ba-12a8-4373-93f3-9f06f0b8ad35 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:08.107012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ce21a-c408-4992-878b-4928d2da9e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:08.107809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ce21a-c408-4992-878b-4928d2da9e92 None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:08.108111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ce21a-c408-4992-878b-4928d2da9e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:08.108402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ce21a-c408-4992-878b-4928d2da9e92 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:08.109210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ce21a-c408-4992-878b-4928d2da9e92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:08.110898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ce21a-c408-4992-878b-4928d2da9e92 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:08.140019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 594/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jun 16 18:40:07 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:40:10.587837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397893-5aeb-443c-8f5e-78e0b3d0716d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:10.588424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397893-5aeb-443c-8f5e-78e0b3d0716d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:10.588424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a397893-5aeb-443c-8f5e-78e0b3d0716d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:10.590190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 612/1206] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:10.596373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54667-38ff-48d5-ba16-29c71cb2ca22 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:10.596911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54667-38ff-48d5-ba16-29c71cb2ca22 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:10.596911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54667-38ff-48d5-ba16-29c71cb2ca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:10.617617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-13e54667-38ff-48d5-ba16-29c71cb2ca22 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:10.619074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-13e54667-38ff-48d5-ba16-29c71cb2ca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:10.707360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 595/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:10.731864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397893-5aeb-443c-8f5e-78e0b3d0716d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:10.867815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a397893-5aeb-443c-8f5e-78e0b3d0716d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:10.905018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18e211-ece2-48f9-812c-39d59197b2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:10.905907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18e211-ece2-48f9-812c-39d59197b2a3 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:10.906197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18e211-ece2-48f9-812c-39d59197b2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:10.906521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18e211-ece2-48f9-812c-39d59197b2a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:10.918792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18e211-ece2-48f9-812c-39d59197b2a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-4a18e211-ece2-48f9-812c-39d59197b2a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:40:10.927809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:10.928841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:10.930313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 613/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:40:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:10.935468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e54667-38ff-48d5-ba16-29c71cb2ca22 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:10.985801 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:11.062331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e54667-38ff-48d5-ba16-29c71cb2ca22 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:11.103732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba1a49-8a4a-4bba-ae2e-63689d6bb887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:11.104421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba1a49-8a4a-4bba-ae2e-63689d6bb887 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:11.104687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba1a49-8a4a-4bba-ae2e-63689d6bb887 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:11.104960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba1a49-8a4a-4bba-ae2e-63689d6bb887 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:11.105710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba1a49-8a4a-4bba-ae2e-63689d6bb887 None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:11.106014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba1a49-8a4a-4bba-ae2e-63689d6bb887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:11.107419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba1a49-8a4a-4bba-ae2e-63689d6bb887 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:11.118150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 596/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:40:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:11.124098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18e211-ece2-48f9-812c-39d59197b2a3 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:11.184752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:11.248590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18e211-ece2-48f9-812c-39d59197b2a3 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:11.295297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe359b5-2ac1-466e-8bac-54989be705b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:11.296422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe359b5-2ac1-466e-8bac-54989be705b1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:11.296655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe359b5-2ac1-466e-8bac-54989be705b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:11.297043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe359b5-2ac1-466e-8bac-54989be705b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:11.316586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe359b5-2ac1-466e-8bac-54989be705b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:11.318124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe359b5-2ac1-466e-8bac-54989be705b1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-abe359b5-2ac1-466e-8bac-54989be705b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:11.341472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:11.347156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:11.348638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:11.348638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:11.348638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:11.348638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:11.348638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 614/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:40:11.352593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba1a49-8a4a-4bba-ae2e-63689d6bb887 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:11.466898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:11.469677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba1a49-8a4a-4bba-ae2e-63689d6bb887 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:11.511810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018fb4-b8d0-41c3-aad1-dd1b6afba7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:11.512469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018fb4-b8d0-41c3-aad1-dd1b6afba7fb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:11.512766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018fb4-b8d0-41c3-aad1-dd1b6afba7fb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:11.513027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018fb4-b8d0-41c3-aad1-dd1b6afba7fb None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:11.513738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa018fb4-b8d0-41c3-aad1-dd1b6afba7fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:11.514142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa018fb4-b8d0-41c3-aad1-dd1b6afba7fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:11.515449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa018fb4-b8d0-41c3-aad1-dd1b6afba7fb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:11.529542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 597/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:11.535875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe359b5-2ac1-466e-8bac-54989be705b1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:11.663153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe359b5-2ac1-466e-8bac-54989be705b1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:11.665509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:11.700460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164568-feca-4f4f-baa0-15190bcf95a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:11.701273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164568-feca-4f4f-baa0-15190bcf95a9 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:11.701568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164568-feca-4f4f-baa0-15190bcf95a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:11.701835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e164568-feca-4f4f-baa0-15190bcf95a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:11.710033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164568-feca-4f4f-baa0-15190bcf95a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:11.711580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e164568-feca-4f4f-baa0-15190bcf95a9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-7e164568-feca-4f4f-baa0-15190bcf95a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:40:11.727380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:11.728646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:11.729615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 615/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:11.734273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018fb4-b8d0-41c3-aad1-dd1b6afba7fb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:11.856078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018fb4-b8d0-41c3-aad1-dd1b6afba7fb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:11.905314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87916eb-adca-4a7d-acd6-41798e77e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:11.906010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87916eb-adca-4a7d-acd6-41798e77e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:11.906297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87916eb-adca-4a7d-acd6-41798e77e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:11.906604 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87916eb-adca-4a7d-acd6-41798e77e5b8 None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:11.907535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87916eb-adca-4a7d-acd6-41798e77e5b8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:11.907919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87916eb-adca-4a7d-acd6-41798e77e5b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:11.909769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87916eb-adca-4a7d-acd6-41798e77e5b8 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:11.932334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 598/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jun 16 18:40:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:11.938401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164568-feca-4f4f-baa0-15190bcf95a9 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:12.066999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e164568-feca-4f4f-baa0-15190bcf95a9 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:12.112965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4be455-d2ea-46ba-99a9-1952a662c653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:12.112965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4be455-d2ea-46ba-99a9-1952a662c653 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:12.112965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4be455-d2ea-46ba-99a9-1952a662c653 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:12.113903 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4be455-d2ea-46ba-99a9-1952a662c653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:12.156083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:12.201459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4be455-d2ea-46ba-99a9-1952a662c653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:12.203123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4be455-d2ea-46ba-99a9-1952a662c653 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:12.314677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 616/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:40:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:40:12.321085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87916eb-adca-4a7d-acd6-41798e77e5b8 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:12.342755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:12.443030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87916eb-adca-4a7d-acd6-41798e77e5b8 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:12.490893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde6223-7162-4a56-82b0-46bb399e9139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:12.492525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde6223-7162-4a56-82b0-46bb399e9139 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:12.492525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde6223-7162-4a56-82b0-46bb399e9139 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:12.492525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde6223-7162-4a56-82b0-46bb399e9139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:12.513375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde6223-7162-4a56-82b0-46bb399e9139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:12.514890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde6223-7162-4a56-82b0-46bb399e9139 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-2cde6223-7162-4a56-82b0-46bb399e9139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:12.533300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:12.534297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:12.536123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:12.536123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:12.536123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:12.536123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:12.538735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 599/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:12.541147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4be455-d2ea-46ba-99a9-1952a662c653 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:12.614512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:12.666925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4be455-d2ea-46ba-99a9-1952a662c653 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:12.709633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b8054-1961-46a0-9a8c-7143ca075ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:12.711087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b8054-1961-46a0-9a8c-7143ca075ca7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:12.711530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b8054-1961-46a0-9a8c-7143ca075ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:12.711884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b8054-1961-46a0-9a8c-7143ca075ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:12.712790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b8054-1961-46a0-9a8c-7143ca075ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:12.713320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b8054-1961-46a0-9a8c-7143ca075ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:12.715068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b8054-1961-46a0-9a8c-7143ca075ca7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:12.734844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 617/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:12.736004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde6223-7162-4a56-82b0-46bb399e9139 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:12.813002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:12.850941 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde6223-7162-4a56-82b0-46bb399e9139 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:12.897503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6e8da-0124-4510-902f-ff1405d104b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:12.898241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6e8da-0124-4510-902f-ff1405d104b1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:12.898557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6e8da-0124-4510-902f-ff1405d104b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:12.898838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6e8da-0124-4510-902f-ff1405d104b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:12.906725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6e8da-0124-4510-902f-ff1405d104b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:12.908207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6e8da-0124-4510-902f-ff1405d104b1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-a5b6e8da-0124-4510-902f-ff1405d104b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:40:12.926360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:12.927620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:12.928735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:40:12.928735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:40:12.928735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:40:12.928735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:40:12.928735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:40:12.928735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:40:12.928735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:12.928735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:12.928735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 600/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:12.933746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b8054-1961-46a0-9a8c-7143ca075ca7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:13.057226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b8054-1961-46a0-9a8c-7143ca075ca7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:13.084062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:13.104824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9d0a4-b954-4541-bbb7-7dcb92da950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:13.105510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9d0a4-b954-4541-bbb7-7dcb92da950b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:13.105813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9d0a4-b954-4541-bbb7-7dcb92da950b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:13.106074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9d0a4-b954-4541-bbb7-7dcb92da950b None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:13.106890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9d0a4-b954-4541-bbb7-7dcb92da950b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:13.107202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9d0a4-b954-4541-bbb7-7dcb92da950b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:13.108638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9d0a4-b954-4541-bbb7-7dcb92da950b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:13.127346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 618/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:13.128571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6e8da-0124-4510-902f-ff1405d104b1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:13.236913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6e8da-0124-4510-902f-ff1405d104b1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:13.266819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:13.274068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e2900-4c89-4cee-a7fd-1c6164ded59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:13.274767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2900-4c89-4cee-a7fd-1c6164ded59e None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:13.275078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2900-4c89-4cee-a7fd-1c6164ded59e None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:13.275330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2900-4c89-4cee-a7fd-1c6164ded59e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:13.276168 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e2900-4c89-4cee-a7fd-1c6164ded59e None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=167e32465f314f4caf9f8df4a4710dbe) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:13.276485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e2900-4c89-4cee-a7fd-1c6164ded59e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:13.277927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e2900-4c89-4cee-a7fd-1c6164ded59e None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:13.283963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 601/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:40:13 2022] GET /identity/v3/role_assignments?user.id=167e32465f314f4caf9f8df4a4710dbe&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:40:15.412958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d423-d410-46a1-a3a0-e114beff66dd None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:15.413547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d423-d410-46a1-a3a0-e114beff66dd None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:15.413547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16d423-d410-46a1-a3a0-e114beff66dd None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:15.415071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 619/1220] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:15.420528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3063-9503-41db-9432-00a78daabc22 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:15.420989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3063-9503-41db-9432-00a78daabc22 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:15.421141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3063-9503-41db-9432-00a78daabc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:15.438743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-cd6b3063-9503-41db-9432-00a78daabc22 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:15.440193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-cd6b3063-9503-41db-9432-00a78daabc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:15.513341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 602/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:15.536528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16d423-d410-46a1-a3a0-e114beff66dd None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:15.642667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16d423-d410-46a1-a3a0-e114beff66dd None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:15.678137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28144f-2e8c-434e-afd1-981c2813202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:15.679014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28144f-2e8c-434e-afd1-981c2813202a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:15.679300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28144f-2e8c-434e-afd1-981c2813202a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:15.679580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28144f-2e8c-434e-afd1-981c2813202a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:15.692108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28144f-2e8c-434e-afd1-981c2813202a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-7a28144f-2e8c-434e-afd1-981c2813202a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:40:15.699861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:15.700987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:15.702020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:15.709998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 620/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:40:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:15.710165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3063-9503-41db-9432-00a78daabc22 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:15.810872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3063-9503-41db-9432-00a78daabc22 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:15.841356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:15.854775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1546f90-1e68-43d3-a5f4-a2ab9b2958fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:15.855458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1546f90-1e68-43d3-a5f4-a2ab9b2958fb None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:15.855743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1546f90-1e68-43d3-a5f4-a2ab9b2958fb None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:15.856024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1546f90-1e68-43d3-a5f4-a2ab9b2958fb None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:15.856778 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1546f90-1e68-43d3-a5f4-a2ab9b2958fb None admin] RBAC: Adding query filter params (name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:15.857087 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1546f90-1e68-43d3-a5f4-a2ab9b2958fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:15.858499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1546f90-1e68-43d3-a5f4-a2ab9b2958fb None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:15.868116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 603/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:40:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:15.873875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28144f-2e8c-434e-afd1-981c2813202a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:15.922258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:15.987655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28144f-2e8c-434e-afd1-981c2813202a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:16.028622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c3233-c68a-4511-8cce-68f8158174d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:16.029498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c3233-c68a-4511-8cce-68f8158174d1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:16.029870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c3233-c68a-4511-8cce-68f8158174d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:16.030242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c3233-c68a-4511-8cce-68f8158174d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:16.043608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c3233-c68a-4511-8cce-68f8158174d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:16.045453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c3233-c68a-4511-8cce-68f8158174d1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-2f9c3233-c68a-4511-8cce-68f8158174d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:16.064301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:16.065425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:16.066537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:16.066537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:16.066537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:16.066537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:16.066537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 621/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:16.072614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1546f90-1e68-43d3-a5f4-a2ab9b2958fb None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:16.187933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1546f90-1e68-43d3-a5f4-a2ab9b2958fb None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:16.226346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b2785-fbc9-4049-99b5-6e5aba41aa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:16.227139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b2785-fbc9-4049-99b5-6e5aba41aa9b None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:16.227538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b2785-fbc9-4049-99b5-6e5aba41aa9b None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:16.227809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b2785-fbc9-4049-99b5-6e5aba41aa9b None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:16.228712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b2785-fbc9-4049-99b5-6e5aba41aa9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:16.229110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b2785-fbc9-4049-99b5-6e5aba41aa9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:16.230584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b2785-fbc9-4049-99b5-6e5aba41aa9b None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:16.244990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 604/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:16.251960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c3233-c68a-4511-8cce-68f8158174d1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:16.359961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:16.368300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c3233-c68a-4511-8cce-68f8158174d1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:16.406312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341e9ce-c89f-4118-9157-4020878d8bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:16.407242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341e9ce-c89f-4118-9157-4020878d8bae None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:16.407611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341e9ce-c89f-4118-9157-4020878d8bae None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:16.407947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341e9ce-c89f-4118-9157-4020878d8bae None admin] PATH_INFO: `/v3/users/placement` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:16.417501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341e9ce-c89f-4118-9157-4020878d8bae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:16.419113 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341e9ce-c89f-4118-9157-4020878d8bae None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-c341e9ce-c89f-4118-9157-4020878d8bae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:40:16.434481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:16.435730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:16.436729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 622/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:16.442319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b2785-fbc9-4049-99b5-6e5aba41aa9b None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:16.494457 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:16.558710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b2785-fbc9-4049-99b5-6e5aba41aa9b None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:16.598433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3c073-0b41-4c0b-af8e-e41b277a150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:16.599200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3c073-0b41-4c0b-af8e-e41b277a150f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:16.599489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3c073-0b41-4c0b-af8e-e41b277a150f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:16.599817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3c073-0b41-4c0b-af8e-e41b277a150f None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:16.600768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3c073-0b41-4c0b-af8e-e41b277a150f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:16.601043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3c073-0b41-4c0b-af8e-e41b277a150f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:16.602594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3c073-0b41-4c0b-af8e-e41b277a150f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:16.622754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 605/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jun 16 18:40:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:16.628632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341e9ce-c89f-4118-9157-4020878d8bae None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:16.740992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341e9ce-c89f-4118-9157-4020878d8bae None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:16.778447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683ee76-1291-439b-b421-c7421c5aad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:16.779168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683ee76-1291-439b-b421-c7421c5aad4d None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:16.779449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683ee76-1291-439b-b421-c7421c5aad4d None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:16.779722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683ee76-1291-439b-b421-c7421c5aad4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:16.791502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683ee76-1291-439b-b421-c7421c5aad4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:16.793036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683ee76-1291-439b-b421-c7421c5aad4d None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-e683ee76-1291-439b-b421-c7421c5aad4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:16.811699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:16.812865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:16.814351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:16.814351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:16.814351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:16.814351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:16.818610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 623/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:16.820237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3c073-0b41-4c0b-af8e-e41b277a150f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:16.937672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3c073-0b41-4c0b-af8e-e41b277a150f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:16.940781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:16.979311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aa0da-93d3-4c46-8a7e-e71a740f47dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:16.979979 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aa0da-93d3-4c46-8a7e-e71a740f47dd None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:16.980263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aa0da-93d3-4c46-8a7e-e71a740f47dd None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:16.980539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aa0da-93d3-4c46-8a7e-e71a740f47dd None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:16.981262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4aa0da-93d3-4c46-8a7e-e71a740f47dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:16.981570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4aa0da-93d3-4c46-8a7e-e71a740f47dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:16.982982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4aa0da-93d3-4c46-8a7e-e71a740f47dd None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:16.999597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 606/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:17.000790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683ee76-1291-439b-b421-c7421c5aad4d None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:17.010928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:17.108054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683ee76-1291-439b-b421-c7421c5aad4d None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:17.147984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25fe91-eac3-4792-a41c-6f785bbbb761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:17.148832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25fe91-eac3-4792-a41c-6f785bbbb761 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:17.149119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25fe91-eac3-4792-a41c-6f785bbbb761 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:17.149402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25fe91-eac3-4792-a41c-6f785bbbb761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:17.157771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25fe91-eac3-4792-a41c-6f785bbbb761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:17.159656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25fe91-eac3-4792-a41c-6f785bbbb761 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-df25fe91-eac3-4792-a41c-6f785bbbb761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:40:17.175427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:17.176703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:17.177882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:40:17.177882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:40:17.177882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:40:17.177882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:40:17.177882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:40:17.177882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:40:17.177882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:17.177882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:17.179844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 624/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:40:17.186187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aa0da-93d3-4c46-8a7e-e71a740f47dd None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:17.294215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aa0da-93d3-4c46-8a7e-e71a740f47dd None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:17.330993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f4458-3333-42b2-a634-dfbc50e9dc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:17.331623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f4458-3333-42b2-a634-dfbc50e9dc07 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:17.334375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f4458-3333-42b2-a634-dfbc50e9dc07 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:17.334619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f4458-3333-42b2-a634-dfbc50e9dc07 None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:17.335436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f4458-3333-42b2-a634-dfbc50e9dc07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:17.335747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f4458-3333-42b2-a634-dfbc50e9dc07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:17.337292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f4458-3333-42b2-a634-dfbc50e9dc07 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:17.352671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 607/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:17.358782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25fe91-eac3-4792-a41c-6f785bbbb761 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:17.430891 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:17.469395 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25fe91-eac3-4792-a41c-6f785bbbb761 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:17.508176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8dd05-22bc-4ea9-845b-bca323e59036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:17.509123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8dd05-22bc-4ea9-845b-bca323e59036 None admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:17.509431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8dd05-22bc-4ea9-845b-bca323e59036 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:17.509705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8dd05-22bc-4ea9-845b-bca323e59036 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/167e32465f314f4caf9f8df4a4710dbe/roles/9e9a366e60114fa1ae7e33a6a7af2934` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:17.526416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8dd05-22bc-4ea9-845b-bca323e59036 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=167e32465f314f4caf9f8df4a4710dbe, role_id=9e9a366e60114fa1ae7e33a6a7af2934)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:17.528030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8dd05-22bc-4ea9-845b-bca323e59036 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:17.543957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 625/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:40:17 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/167e32465f314f4caf9f8df4a4710dbe/roles/9e9a366e60114fa1ae7e33a6a7af2934 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:40:19.691140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5ddf6-5eac-438b-8651-ba39026f95c0 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:19.691963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5ddf6-5eac-438b-8651-ba39026f95c0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:19.691963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5ddf6-5eac-438b-8651-ba39026f95c0 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:19.693050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 608/1233] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:19.699440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc02c-e7a3-40b5-b685-ac04fde97a1f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:19.699893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc02c-e7a3-40b5-b685-ac04fde97a1f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:19.700041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc02c-e7a3-40b5-b685-ac04fde97a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:19.718464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-506dc02c-e7a3-40b5-b685-ac04fde97a1f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:19.719773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-506dc02c-e7a3-40b5-b685-ac04fde97a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:19.798454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 626/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:19.823757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5ddf6-5eac-438b-8651-ba39026f95c0 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:19.851054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:19.944318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5ddf6-5eac-438b-8651-ba39026f95c0 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:19.987210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46b69-0a79-46dd-b00e-d6a3ae29d2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:19.988620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46b69-0a79-46dd-b00e-d6a3ae29d2da None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:19.988896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46b69-0a79-46dd-b00e-d6a3ae29d2da None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:19.989175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46b69-0a79-46dd-b00e-d6a3ae29d2da None admin] PATH_INFO: `/v3/roles/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:20.001333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf46b69-0a79-46dd-b00e-d6a3ae29d2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-2bf46b69-0a79-46dd-b00e-d6a3ae29d2da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:40:20.009784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:20.010763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:20.011634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 609/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jun 16 18:40:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:20.017086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc02c-e7a3-40b5-b685-ac04fde97a1f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:20.066084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.125572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc02c-e7a3-40b5-b685-ac04fde97a1f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:20.167293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13a109-f6ee-49eb-a515-7b75520ab841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:20.168024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13a109-f6ee-49eb-a515-7b75520ab841 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:20.168306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13a109-f6ee-49eb-a515-7b75520ab841 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:20.168624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13a109-f6ee-49eb-a515-7b75520ab841 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:20.169460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13a109-f6ee-49eb-a515-7b75520ab841 None admin] RBAC: Adding query filter params (name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:20.169811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13a109-f6ee-49eb-a515-7b75520ab841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:20.171271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13a109-f6ee-49eb-a515-7b75520ab841 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:20.180874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 627/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jun 16 18:40:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:20.186674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46b69-0a79-46dd-b00e-d6a3ae29d2da None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:20.276371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.294395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46b69-0a79-46dd-b00e-d6a3ae29d2da None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:20.334140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26963-c527-4c30-ab56-4e72f2543d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:20.335092 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26963-c527-4c30-ab56-4e72f2543d68 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:20.335386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26963-c527-4c30-ab56-4e72f2543d68 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:20.335704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26963-c527-4c30-ab56-4e72f2543d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:20.348758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26963-c527-4c30-ab56-4e72f2543d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:20.350339 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26963-c527-4c30-ab56-4e72f2543d68 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-a8f26963-c527-4c30-ab56-4e72f2543d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:20.370232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:20.371345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:20.373038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:20.373038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:20.373038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:20.373038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:20.373038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 610/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:20.378089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13a109-f6ee-49eb-a515-7b75520ab841 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:20.489406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13a109-f6ee-49eb-a515-7b75520ab841 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:20.499895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.528796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16949bd6-0b56-41dc-ab9a-beaca8b21c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:20.529625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16949bd6-0b56-41dc-ab9a-beaca8b21c4e None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:20.529912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16949bd6-0b56-41dc-ab9a-beaca8b21c4e None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:20.530284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16949bd6-0b56-41dc-ab9a-beaca8b21c4e None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:20.531080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16949bd6-0b56-41dc-ab9a-beaca8b21c4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:20.531409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16949bd6-0b56-41dc-ab9a-beaca8b21c4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:20.533065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16949bd6-0b56-41dc-ab9a-beaca8b21c4e None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:20.548078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 628/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:40:20.554959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26963-c527-4c30-ab56-4e72f2543d68 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:20.667303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26963-c527-4c30-ab56-4e72f2543d68 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:20.705758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b800af4-7b19-4cac-b2fa-ad32cb3aedf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:20.706723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b800af4-7b19-4cac-b2fa-ad32cb3aedf4 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:20.707074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b800af4-7b19-4cac-b2fa-ad32cb3aedf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:20.707406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b800af4-7b19-4cac-b2fa-ad32cb3aedf4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:20.710545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.716804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b800af4-7b19-4cac-b2fa-ad32cb3aedf4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:20.718656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b800af4-7b19-4cac-b2fa-ad32cb3aedf4 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-9b800af4-7b19-4cac-b2fa-ad32cb3aedf4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:40:20.735624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:20.736782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:20.738566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 611/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:20.744134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16949bd6-0b56-41dc-ab9a-beaca8b21c4e None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:20.860175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16949bd6-0b56-41dc-ab9a-beaca8b21c4e None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:20.898498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d904-0b39-4058-b52e-cf6cf4690ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:20.899185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d904-0b39-4058-b52e-cf6cf4690ea7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:20.899471 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d904-0b39-4058-b52e-cf6cf4690ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:20.899748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d904-0b39-4058-b52e-cf6cf4690ea7 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:20.900590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105d904-0b39-4058-b52e-cf6cf4690ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:20.900906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105d904-0b39-4058-b52e-cf6cf4690ea7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:20.902333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105d904-0b39-4058-b52e-cf6cf4690ea7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:20.922293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 629/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jun 16 18:40:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:20.929369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b800af4-7b19-4cac-b2fa-ad32cb3aedf4 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:21.042636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b800af4-7b19-4cac-b2fa-ad32cb3aedf4 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:21.078238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c234d-3aae-47dd-a38f-57c30383d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:21.079003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c234d-3aae-47dd-a38f-57c30383d372 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:21.079286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c234d-3aae-47dd-a38f-57c30383d372 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:21.079567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c234d-3aae-47dd-a38f-57c30383d372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:21.147190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:21.155502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c234d-3aae-47dd-a38f-57c30383d372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:21.157578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c234d-3aae-47dd-a38f-57c30383d372 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:21.279627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 612/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:40:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:40:21.287796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d904-0b39-4058-b52e-cf6cf4690ea7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:21.320458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:21.397233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d904-0b39-4058-b52e-cf6cf4690ea7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:21.433167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdb380-dc66-445a-b082-7e152b7f16c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:21.433962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdb380-dc66-445a-b082-7e152b7f16c7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:21.434240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdb380-dc66-445a-b082-7e152b7f16c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:21.434545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdb380-dc66-445a-b082-7e152b7f16c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:21.445960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdb380-dc66-445a-b082-7e152b7f16c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:21.447460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdb380-dc66-445a-b082-7e152b7f16c7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-aabdb380-dc66-445a-b082-7e152b7f16c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:21.466429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:21.467523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:21.468630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:21.468630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:21.468630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:21.468630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:21.468630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 630/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 18:40:21.474915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c234d-3aae-47dd-a38f-57c30383d372 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:21.576875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:21.583984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c234d-3aae-47dd-a38f-57c30383d372 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:21.622612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144763a4-427c-4288-a2eb-42854a1e632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:21.623374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144763a4-427c-4288-a2eb-42854a1e632d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:21.623643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144763a4-427c-4288-a2eb-42854a1e632d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:21.623920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144763a4-427c-4288-a2eb-42854a1e632d None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:21.624683 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144763a4-427c-4288-a2eb-42854a1e632d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:21.624996 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144763a4-427c-4288-a2eb-42854a1e632d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:21.626416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144763a4-427c-4288-a2eb-42854a1e632d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:21.639020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 613/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:21.645440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdb380-dc66-445a-b082-7e152b7f16c7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:21.729571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:21.752464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdb380-dc66-445a-b082-7e152b7f16c7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:21.787642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908f032-a136-467f-9866-9406b031ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:21.788482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f032-a136-467f-9866-9406b031ca1a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:21.788762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f032-a136-467f-9866-9406b031ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:21.789033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908f032-a136-467f-9866-9406b031ca1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:21.796198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908f032-a136-467f-9866-9406b031ca1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:21.797660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908f032-a136-467f-9866-9406b031ca1a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-4908f032-a136-467f-9866-9406b031ca1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:40:21.812934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:21.814473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:21.815516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:40:21.815516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:40:21.815516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:40:21.815516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:40:21.815516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:40:21.815516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:40:21.815516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:21.815516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:21.815516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 631/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:21.821233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144763a4-427c-4288-a2eb-42854a1e632d None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:21.936035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144763a4-427c-4288-a2eb-42854a1e632d None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:21.975180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a5908-6ffd-426f-a262-f68789fe590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:21.975948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5908-6ffd-426f-a262-f68789fe590d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:21.976236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5908-6ffd-426f-a262-f68789fe590d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:21.976520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a5908-6ffd-426f-a262-f68789fe590d None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:21.977458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a5908-6ffd-426f-a262-f68789fe590d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:21.977803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a5908-6ffd-426f-a262-f68789fe590d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:21.979287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a5908-6ffd-426f-a262-f68789fe590d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:22.001266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 614/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:22.002860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908f032-a136-467f-9866-9406b031ca1a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:22.114872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908f032-a136-467f-9866-9406b031ca1a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:22.165613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63621866-1e56-4296-a5ef-fa17e206895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:22.166433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621866-1e56-4296-a5ef-fa17e206895c None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:22.167015 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621866-1e56-4296-a5ef-fa17e206895c None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:22.167484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621866-1e56-4296-a5ef-fa17e206895c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:22.168767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63621866-1e56-4296-a5ef-fa17e206895c None admin] RBAC: Adding query filter params (role.id=9e9a366e60114fa1ae7e33a6a7af2934, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=167e32465f314f4caf9f8df4a4710dbe) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:22.169334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63621866-1e56-4296-a5ef-fa17e206895c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:22.171585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63621866-1e56-4296-a5ef-fa17e206895c None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:22.180345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 632/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:40:22 2022] GET /identity/v3/role_assignments?user.id=167e32465f314f4caf9f8df4a4710dbe&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=9e9a366e60114fa1ae7e33a6a7af2934 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:24.792723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7748f-e437-4dad-874c-b482c2974d1f None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:24.793331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7748f-e437-4dad-874c-b482c2974d1f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:24.793331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7748f-e437-4dad-874c-b482c2974d1f None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:24.794583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 615/1247] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:24.808666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4ab2-66f9-4dc0-ab3b-2aca4e0887cf None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:24.809190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4ab2-66f9-4dc0-ab3b-2aca4e0887cf None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:24.809301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4ab2-66f9-4dc0-ab3b-2aca4e0887cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:24.816894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:24.831159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-dcba4ab2-66f9-4dc0-ab3b-2aca4e0887cf None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:24.833225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dcba4ab2-66f9-4dc0-ab3b-2aca4e0887cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:24.908953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 633/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:24.935827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7748f-e437-4dad-874c-b482c2974d1f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:24.957128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:25.059875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7748f-e437-4dad-874c-b482c2974d1f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:25.105310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae696d-0bc4-4249-a7c2-5b28135be232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:25.106218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae696d-0bc4-4249-a7c2-5b28135be232 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:25.106540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae696d-0bc4-4249-a7c2-5b28135be232 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:25.106892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae696d-0bc4-4249-a7c2-5b28135be232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:25.119417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae696d-0bc4-4249-a7c2-5b28135be232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-f9ae696d-0bc4-4249-a7c2-5b28135be232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:40:25.128572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:25.129695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:25.130591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 616/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:40:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:25.136310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4ab2-66f9-4dc0-ab3b-2aca4e0887cf None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:25.259317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4ab2-66f9-4dc0-ab3b-2aca4e0887cf None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:25.305677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:25.313139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396e695-b72b-40ee-b184-c185cc0dadc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:25.314148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396e695-b72b-40ee-b184-c185cc0dadc1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:25.314585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396e695-b72b-40ee-b184-c185cc0dadc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:25.315022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396e695-b72b-40ee-b184-c185cc0dadc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:25.316491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396e695-b72b-40ee-b184-c185cc0dadc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:25.316844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396e695-b72b-40ee-b184-c185cc0dadc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:25.318194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396e695-b72b-40ee-b184-c185cc0dadc1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:25.327291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 634/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:25.333832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae696d-0bc4-4249-a7c2-5b28135be232 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:25.421767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:25.447419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae696d-0bc4-4249-a7c2-5b28135be232 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:25.487267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52a72a-e5ae-4bc6-b466-9c79a635c1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:25.488103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a72a-e5ae-4bc6-b466-9c79a635c1e1 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:25.488382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a72a-e5ae-4bc6-b466-9c79a635c1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:25.488662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a72a-e5ae-4bc6-b466-9c79a635c1e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:25.502271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52a72a-e5ae-4bc6-b466-9c79a635c1e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:25.504442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52a72a-e5ae-4bc6-b466-9c79a635c1e1 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-5b52a72a-e5ae-4bc6-b466-9c79a635c1e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:25.525745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:25.526737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:25.527651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:25.527651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:25.527651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:25.527651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:25.527651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 617/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:25.533553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396e695-b72b-40ee-b184-c185cc0dadc1 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:25.646764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396e695-b72b-40ee-b184-c185cc0dadc1 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:25.685214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc190cb4-612c-43b3-88d9-933cf9706b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:25.685908 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc190cb4-612c-43b3-88d9-933cf9706b2b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:25.686191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc190cb4-612c-43b3-88d9-933cf9706b2b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:25.686519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc190cb4-612c-43b3-88d9-933cf9706b2b None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:25.687250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc190cb4-612c-43b3-88d9-933cf9706b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:25.687656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc190cb4-612c-43b3-88d9-933cf9706b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:25.689800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc190cb4-612c-43b3-88d9-933cf9706b2b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:25.706026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 635/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:25.712150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52a72a-e5ae-4bc6-b466-9c79a635c1e1 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:25.827783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52a72a-e5ae-4bc6-b466-9c79a635c1e1 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:25.856213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:25.865078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6cad4-85e8-4b5a-9f13-d2130e0ad247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:25.866041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6cad4-85e8-4b5a-9f13-d2130e0ad247 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:25.866334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6cad4-85e8-4b5a-9f13-d2130e0ad247 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:25.866644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6cad4-85e8-4b5a-9f13-d2130e0ad247 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:25.874886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6cad4-85e8-4b5a-9f13-d2130e0ad247 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:25.876346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6cad4-85e8-4b5a-9f13-d2130e0ad247 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-54d6cad4-85e8-4b5a-9f13-d2130e0ad247 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:40:25.892102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:25.893136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:25.894415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 618/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:25.900046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc190cb4-612c-43b3-88d9-933cf9706b2b None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:25.963632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:26.020606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc190cb4-612c-43b3-88d9-933cf9706b2b None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:26.061288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1152b-4a17-4c09-bd14-b8d409451125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:26.061984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1152b-4a17-4c09-bd14-b8d409451125 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:26.062273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1152b-4a17-4c09-bd14-b8d409451125 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:26.062614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1152b-4a17-4c09-bd14-b8d409451125 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:26.063577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1152b-4a17-4c09-bd14-b8d409451125 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:26.064198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1152b-4a17-4c09-bd14-b8d409451125 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:26.065807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1152b-4a17-4c09-bd14-b8d409451125 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:26.084971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 636/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jun 16 18:40:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:40:26.091425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6cad4-85e8-4b5a-9f13-d2130e0ad247 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:26.239812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6cad4-85e8-4b5a-9f13-d2130e0ad247 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:26.278454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a2b2c-03ee-46ae-9316-c611634032e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:26.279147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2b2c-03ee-46ae-9316-c611634032e6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:26.279500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2b2c-03ee-46ae-9316-c611634032e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:26.279858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2b2c-03ee-46ae-9316-c611634032e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:26.349578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:26.366806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a2b2c-03ee-46ae-9316-c611634032e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:26.368285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a2b2c-03ee-46ae-9316-c611634032e6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:26.474680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 619/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:40:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:40:26.480412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1152b-4a17-4c09-bd14-b8d409451125 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:26.595323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1152b-4a17-4c09-bd14-b8d409451125 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:26.612386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:26.636050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9980ef1-5399-4d18-94f7-6d5f9a7f8bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:26.636865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9980ef1-5399-4d18-94f7-6d5f9a7f8bda None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:26.637150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9980ef1-5399-4d18-94f7-6d5f9a7f8bda None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:26.637451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9980ef1-5399-4d18-94f7-6d5f9a7f8bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:26.649405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9980ef1-5399-4d18-94f7-6d5f9a7f8bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:26.650982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9980ef1-5399-4d18-94f7-6d5f9a7f8bda None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-f9980ef1-5399-4d18-94f7-6d5f9a7f8bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:26.671040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:26.672317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:26.673230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:26.673230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:26.673230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:26.673230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:26.673230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 637/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:26.678278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a2b2c-03ee-46ae-9316-c611634032e6 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:26.787451 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:26.803277 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a2b2c-03ee-46ae-9316-c611634032e6 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:26.841472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87436d8-c425-4f7f-9fec-5c9536850484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:26.842159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87436d8-c425-4f7f-9fec-5c9536850484 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:26.842538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87436d8-c425-4f7f-9fec-5c9536850484 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:26.842823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87436d8-c425-4f7f-9fec-5c9536850484 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:26.843644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87436d8-c425-4f7f-9fec-5c9536850484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:26.843955 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87436d8-c425-4f7f-9fec-5c9536850484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:26.845407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87436d8-c425-4f7f-9fec-5c9536850484 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:26.862181 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 620/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:40:26.863491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9980ef1-5399-4d18-94f7-6d5f9a7f8bda None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:26.974952 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9980ef1-5399-4d18-94f7-6d5f9a7f8bda None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:27.014281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fe028-a0ae-4221-9652-267772fc7948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:27.015099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fe028-a0ae-4221-9652-267772fc7948 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:27.015380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fe028-a0ae-4221-9652-267772fc7948 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:27.015653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fe028-a0ae-4221-9652-267772fc7948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:27.024140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fe028-a0ae-4221-9652-267772fc7948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:27.025911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fe028-a0ae-4221-9652-267772fc7948 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-286fe028-a0ae-4221-9652-267772fc7948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:40:27.044937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:27.046062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:27.047153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:40:27.047153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:40:27.047153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:40:27.047153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:40:27.047153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:40:27.047153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:40:27.047153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:27.047153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:27.047153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 638/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:27.054165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87436d8-c425-4f7f-9fec-5c9536850484 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:27.197593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87436d8-c425-4f7f-9fec-5c9536850484 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:27.232368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0603b3-f493-4318-af0e-cd7bd9891c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:27.233015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0603b3-f493-4318-af0e-cd7bd9891c4f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:27.233296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0603b3-f493-4318-af0e-cd7bd9891c4f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:27.233575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0603b3-f493-4318-af0e-cd7bd9891c4f None admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:27.234365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0603b3-f493-4318-af0e-cd7bd9891c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:27.234705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0603b3-f493-4318-af0e-cd7bd9891c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:27.236142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0603b3-f493-4318-af0e-cd7bd9891c4f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:27.249682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 621/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:27.256643 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fe028-a0ae-4221-9652-267772fc7948 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:27.288713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:27.371778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fe028-a0ae-4221-9652-267772fc7948 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:27.408146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2e182-c0ff-4b19-acf1-c738e7b8b328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:27.408814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e182-c0ff-4b19-acf1-c738e7b8b328 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:27.409093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e182-c0ff-4b19-acf1-c738e7b8b328 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:27.409364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e182-c0ff-4b19-acf1-c738e7b8b328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:27.410250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2e182-c0ff-4b19-acf1-c738e7b8b328 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=167e32465f314f4caf9f8df4a4710dbe) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:27.410593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2e182-c0ff-4b19-acf1-c738e7b8b328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:27.412056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2e182-c0ff-4b19-acf1-c738e7b8b328 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:27.418479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 639/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:40:27 2022] GET /identity/v3/role_assignments?user.id=167e32465f314f4caf9f8df4a4710dbe&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:29.556215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81191a3-ff1d-45ea-ab98-a8aecd3a83aa None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:29.556793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81191a3-ff1d-45ea-ab98-a8aecd3a83aa None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:29.556793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81191a3-ff1d-45ea-ab98-a8aecd3a83aa None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:29.558111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 622/1261] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:29.563347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b200f5-0bd4-4734-a275-cbaca8535126 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:29.564036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b200f5-0bd4-4734-a275-cbaca8535126 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:29.564165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b200f5-0bd4-4734-a275-cbaca8535126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:29.581148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-33b200f5-0bd4-4734-a275-cbaca8535126 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:29.582333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-33b200f5-0bd4-4734-a275-cbaca8535126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:29.647423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 640/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:29.669120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81191a3-ff1d-45ea-ab98-a8aecd3a83aa None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:29.680527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:29.774605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81191a3-ff1d-45ea-ab98-a8aecd3a83aa None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:29.811821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68ede3-2eca-4655-9b38-8a1e1f56d915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:29.812618 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68ede3-2eca-4655-9b38-8a1e1f56d915 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:29.812901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68ede3-2eca-4655-9b38-8a1e1f56d915 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:29.813177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68ede3-2eca-4655-9b38-8a1e1f56d915 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:29.823468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68ede3-2eca-4655-9b38-8a1e1f56d915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-8c68ede3-2eca-4655-9b38-8a1e1f56d915 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:40:29.831119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:29.832279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:29.833368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 623/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:40:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:29.838499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b200f5-0bd4-4734-a275-cbaca8535126 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:29.856785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:29.934637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b200f5-0bd4-4734-a275-cbaca8535126 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:29.967192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920a812-c7a9-4749-900a-a0b78d5ba477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:29.967852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920a812-c7a9-4749-900a-a0b78d5ba477 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:29.968137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920a812-c7a9-4749-900a-a0b78d5ba477 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:29.968416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920a812-c7a9-4749-900a-a0b78d5ba477 None admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:29.969154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920a812-c7a9-4749-900a-a0b78d5ba477 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:29.969463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920a812-c7a9-4749-900a-a0b78d5ba477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:29.970858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920a812-c7a9-4749-900a-a0b78d5ba477 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:29.979255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 641/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:40:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:29.984893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68ede3-2eca-4655-9b38-8a1e1f56d915 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:30.052229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:30.090546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68ede3-2eca-4655-9b38-8a1e1f56d915 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:30.126106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c782aef-7fcf-4e1e-9397-b122cfbc589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:30.127062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c782aef-7fcf-4e1e-9397-b122cfbc589a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:30.127453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c782aef-7fcf-4e1e-9397-b122cfbc589a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:30.127768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c782aef-7fcf-4e1e-9397-b122cfbc589a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:30.141726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c782aef-7fcf-4e1e-9397-b122cfbc589a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:30.143338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c782aef-7fcf-4e1e-9397-b122cfbc589a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-1c782aef-7fcf-4e1e-9397-b122cfbc589a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:30.162736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:30.163962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:30.165035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:30.165035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:30.165035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:30.165035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:30.165035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 624/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:30.170357 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920a812-c7a9-4749-900a-a0b78d5ba477 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:30.259829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:30.280555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920a812-c7a9-4749-900a-a0b78d5ba477 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:30.316307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b42429-e029-4b63-948d-3df8e8ec5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:30.316874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b42429-e029-4b63-948d-3df8e8ec5b94 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:30.317155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b42429-e029-4b63-948d-3df8e8ec5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:30.317428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b42429-e029-4b63-948d-3df8e8ec5b94 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:30.318140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b42429-e029-4b63-948d-3df8e8ec5b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:30.318471 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b42429-e029-4b63-948d-3df8e8ec5b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:30.319812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b42429-e029-4b63-948d-3df8e8ec5b94 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:30.331871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 642/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:30.337572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c782aef-7fcf-4e1e-9397-b122cfbc589a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:30.440951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c782aef-7fcf-4e1e-9397-b122cfbc589a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:30.461290 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:30.476695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06764c-7ea4-4aaa-9f78-fbaff330dd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:30.477737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06764c-7ea4-4aaa-9f78-fbaff330dd98 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:30.478196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06764c-7ea4-4aaa-9f78-fbaff330dd98 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:30.478676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06764c-7ea4-4aaa-9f78-fbaff330dd98 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:30.490532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06764c-7ea4-4aaa-9f78-fbaff330dd98 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:30.492318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06764c-7ea4-4aaa-9f78-fbaff330dd98 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-2d06764c-7ea4-4aaa-9f78-fbaff330dd98 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:40:30.507751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:30.508763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:30.509805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 625/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:30.515294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b42429-e029-4b63-948d-3df8e8ec5b94 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:30.617544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b42429-e029-4b63-948d-3df8e8ec5b94 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:30.651470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab17c9-8229-4f96-85a4-8f09294ce258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:30.652130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab17c9-8229-4f96-85a4-8f09294ce258 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:30.652415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab17c9-8229-4f96-85a4-8f09294ce258 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:30.652708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab17c9-8229-4f96-85a4-8f09294ce258 None admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:30.653531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab17c9-8229-4f96-85a4-8f09294ce258 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:30.653935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab17c9-8229-4f96-85a4-8f09294ce258 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:30.655821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab17c9-8229-4f96-85a4-8f09294ce258 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:30.664315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:30.672976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 643/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jun 16 18:40:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:30.678864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06764c-7ea4-4aaa-9f78-fbaff330dd98 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:30.785814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06764c-7ea4-4aaa-9f78-fbaff330dd98 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:30.822873 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe31ead-03ca-48f6-a91a-fa5219022163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:30.823681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe31ead-03ca-48f6-a91a-fa5219022163 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:30.823966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe31ead-03ca-48f6-a91a-fa5219022163 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:30.824242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe31ead-03ca-48f6-a91a-fa5219022163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:30.837793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe31ead-03ca-48f6-a91a-fa5219022163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:30.839306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe31ead-03ca-48f6-a91a-fa5219022163 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-efe31ead-03ca-48f6-a91a-fa5219022163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:30.863509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:30.864622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:30.865696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:30.865696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:30.865696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:30.865696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:30.865696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 626/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:30.870559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab17c9-8229-4f96-85a4-8f09294ce258 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:30.968477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab17c9-8229-4f96-85a4-8f09294ce258 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:31.001477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30114b3f-34b2-4026-b1d7-132c3c102ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:31.002136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30114b3f-34b2-4026-b1d7-132c3c102ce7 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:31.002438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30114b3f-34b2-4026-b1d7-132c3c102ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:31.002712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30114b3f-34b2-4026-b1d7-132c3c102ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:31.003991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30114b3f-34b2-4026-b1d7-132c3c102ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:31.004296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30114b3f-34b2-4026-b1d7-132c3c102ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:31.005688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30114b3f-34b2-4026-b1d7-132c3c102ce7 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:31.016978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 644/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:31.022675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe31ead-03ca-48f6-a91a-fa5219022163 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:31.054154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:31.125045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe31ead-03ca-48f6-a91a-fa5219022163 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:31.160815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e2ef-76e3-4a2c-b8cb-9af3be5afcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:31.161596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e2ef-76e3-4a2c-b8cb-9af3be5afcd6 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:31.161880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e2ef-76e3-4a2c-b8cb-9af3be5afcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:31.162154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e2ef-76e3-4a2c-b8cb-9af3be5afcd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:31.168820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e2ef-76e3-4a2c-b8cb-9af3be5afcd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:31.170250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e2ef-76e3-4a2c-b8cb-9af3be5afcd6 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-56d0e2ef-76e3-4a2c-b8cb-9af3be5afcd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:40:31.184917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:31.185945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:31.187188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:40:31.187188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:40:31.187188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:40:31.187188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:40:31.187188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:40:31.187188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:40:31.187188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:31.187188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:31.187188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 627/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:31.192905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30114b3f-34b2-4026-b1d7-132c3c102ce7 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:31.252207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:31.294145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30114b3f-34b2-4026-b1d7-132c3c102ce7 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:31.327464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a261266-2ecc-48a6-8570-ec371b852d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:31.328120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a261266-2ecc-48a6-8570-ec371b852d0a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:31.328399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a261266-2ecc-48a6-8570-ec371b852d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:31.328739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a261266-2ecc-48a6-8570-ec371b852d0a None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:31.329446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a261266-2ecc-48a6-8570-ec371b852d0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:31.329752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a261266-2ecc-48a6-8570-ec371b852d0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:31.331188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a261266-2ecc-48a6-8570-ec371b852d0a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:31.343040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 645/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:31.349610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e2ef-76e3-4a2c-b8cb-9af3be5afcd6 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:31.440128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:31.450173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e2ef-76e3-4a2c-b8cb-9af3be5afcd6 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:31.483735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d431416-d5a7-4d94-be4a-d58218a13054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:31.484627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d431416-d5a7-4d94-be4a-d58218a13054 None admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:31.484907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d431416-d5a7-4d94-be4a-d58218a13054 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:31.485180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d431416-d5a7-4d94-be4a-d58218a13054 None admin] PATH_INFO: `/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/167e32465f314f4caf9f8df4a4710dbe/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:31.487258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d431416-d5a7-4d94-be4a-d58218a13054 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ce75b1ed5614e5ea2b6cadaed5e3287, user_id=167e32465f314f4caf9f8df4a4710dbe, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:31.489315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d431416-d5a7-4d94-be4a-d58218a13054 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:31.510949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 628/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jun 16 18:40:31 2022] PUT /identity/v3/projects/4ce75b1ed5614e5ea2b6cadaed5e3287/users/167e32465f314f4caf9f8df4a4710dbe/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:40:33.641075 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247fff1-135b-4b6d-8451-2e7cdf82beef None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:33.641841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247fff1-135b-4b6d-8451-2e7cdf82beef None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:33.641841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247fff1-135b-4b6d-8451-2e7cdf82beef None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:33.643013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 646/1274] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:33.648865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855bc20-f613-4ab1-988a-e8f29517e6c4 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:33.649282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855bc20-f613-4ab1-988a-e8f29517e6c4 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:33.649424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855bc20-f613-4ab1-988a-e8f29517e6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:33.666251 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a855bc20-f613-4ab1-988a-e8f29517e6c4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:33.667476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a855bc20-f613-4ab1-988a-e8f29517e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:33.735334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 629/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:33.758818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247fff1-135b-4b6d-8451-2e7cdf82beef None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:33.857519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247fff1-135b-4b6d-8451-2e7cdf82beef None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:33.875004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:33.891907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a3332-f228-4afa-a4f9-fe4e710f204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:33.892691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a3332-f228-4afa-a4f9-fe4e710f204a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:33.892974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a3332-f228-4afa-a4f9-fe4e710f204a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:33.893245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a3332-f228-4afa-a4f9-fe4e710f204a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:33.903204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a3332-f228-4afa-a4f9-fe4e710f204a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-618a3332-f228-4afa-a4f9-fe4e710f204a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 18:40:33.910818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:33.912014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 18:40:33.913046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:33.914536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 647/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jun 16 18:40:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:33.918100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855bc20-f613-4ab1-988a-e8f29517e6c4 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:33.997687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:34.016096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855bc20-f613-4ab1-988a-e8f29517e6c4 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:34.049630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db01549-fd0b-4711-9d69-aa667fe1f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:34.050322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db01549-fd0b-4711-9d69-aa667fe1f136 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:34.050635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db01549-fd0b-4711-9d69-aa667fe1f136 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:34.050912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db01549-fd0b-4711-9d69-aa667fe1f136 None admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:34.051658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db01549-fd0b-4711-9d69-aa667fe1f136 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:34.051965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db01549-fd0b-4711-9d69-aa667fe1f136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:34.053346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db01549-fd0b-4711-9d69-aa667fe1f136 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:34.061759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 630/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jun 16 18:40:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:34.068029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a3332-f228-4afa-a4f9-fe4e710f204a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:34.172728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a3332-f228-4afa-a4f9-fe4e710f204a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:34.210333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f65f38-dda0-4c3a-8144-7c45b4e2caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:34.211166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f65f38-dda0-4c3a-8144-7c45b4e2caa0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:34.211449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f65f38-dda0-4c3a-8144-7c45b4e2caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:34.211723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f65f38-dda0-4c3a-8144-7c45b4e2caa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:34.223102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f65f38-dda0-4c3a-8144-7c45b4e2caa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:34.224527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f65f38-dda0-4c3a-8144-7c45b4e2caa0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-93f65f38-dda0-4c3a-8144-7c45b4e2caa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:34.241189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:34.242273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:34.243563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:34.243563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:34.243563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:34.243563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:34.243563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 648/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:34.248115 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db01549-fd0b-4711-9d69-aa667fe1f136 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:34.347293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db01549-fd0b-4711-9d69-aa667fe1f136 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:34.380199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4e785-bf20-48ac-91be-883ec9a59a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:34.380859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4e785-bf20-48ac-91be-883ec9a59a69 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:34.381142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4e785-bf20-48ac-91be-883ec9a59a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:34.381416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4e785-bf20-48ac-91be-883ec9a59a69 None admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:34.382136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4e785-bf20-48ac-91be-883ec9a59a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:34.382469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4e785-bf20-48ac-91be-883ec9a59a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:34.383839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4e785-bf20-48ac-91be-883ec9a59a69 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:34.396004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 631/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:34.401664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f65f38-dda0-4c3a-8144-7c45b4e2caa0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:34.433022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:34.501302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f65f38-dda0-4c3a-8144-7c45b4e2caa0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:34.535591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db225-1aa6-417a-9d8f-dd69eaedbd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:34.536385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db225-1aa6-417a-9d8f-dd69eaedbd09 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:34.536661 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db225-1aa6-417a-9d8f-dd69eaedbd09 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:34.536929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db225-1aa6-417a-9d8f-dd69eaedbd09 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:34.545181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3db225-1aa6-417a-9d8f-dd69eaedbd09 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:34.546634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3db225-1aa6-417a-9d8f-dd69eaedbd09 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-1a3db225-1aa6-417a-9d8f-dd69eaedbd09 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 18:40:34.560551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:34.561653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:34.563032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 649/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:34.568270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4e785-bf20-48ac-91be-883ec9a59a69 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:34.572093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:34.667189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4e785-bf20-48ac-91be-883ec9a59a69 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:34.700807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996e5b1-87c7-491e-82ec-e4148b4bbf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:34.701464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996e5b1-87c7-491e-82ec-e4148b4bbf3f None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:34.701744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996e5b1-87c7-491e-82ec-e4148b4bbf3f None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:34.702011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996e5b1-87c7-491e-82ec-e4148b4bbf3f None admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:34.702864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996e5b1-87c7-491e-82ec-e4148b4bbf3f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:34.703167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996e5b1-87c7-491e-82ec-e4148b4bbf3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:34.704577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996e5b1-87c7-491e-82ec-e4148b4bbf3f None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:34.721199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 632/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jun 16 18:40:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:34.728242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db225-1aa6-417a-9d8f-dd69eaedbd09 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:34.817091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:34.826509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3db225-1aa6-417a-9d8f-dd69eaedbd09 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:34.858715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c21-cd19-4ed9-ac81-0b653d7cb83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:34.859359 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c21-cd19-4ed9-ac81-0b653d7cb83a None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:34.859641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c21-cd19-4ed9-ac81-0b653d7cb83a None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:34.859917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c21-cd19-4ed9-ac81-0b653d7cb83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:34.926162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c21-cd19-4ed9-ac81-0b653d7cb83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:34.927564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c21-cd19-4ed9-ac81-0b653d7cb83a None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:35.013599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:35.023669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 650/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jun 16 18:40:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 18:40:35.029443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996e5b1-87c7-491e-82ec-e4148b4bbf3f None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:35.089302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:35.131351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996e5b1-87c7-491e-82ec-e4148b4bbf3f None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:35.167029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bde137-93a5-4c7a-9020-cae09ccbcf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:35.167828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bde137-93a5-4c7a-9020-cae09ccbcf51 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:35.168111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bde137-93a5-4c7a-9020-cae09ccbcf51 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:35.168385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bde137-93a5-4c7a-9020-cae09ccbcf51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:35.179141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bde137-93a5-4c7a-9020-cae09ccbcf51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:35.180535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bde137-93a5-4c7a-9020-cae09ccbcf51 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-d3bde137-93a5-4c7a-9020-cae09ccbcf51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 18:40:35.199237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:35.200409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:35.201699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 18:40:35.201699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 18:40:35.201699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 18:40:35.201699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:35.201699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 633/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:35.206892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c21-cd19-4ed9-ac81-0b653d7cb83a None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:35.302373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c21-cd19-4ed9-ac81-0b653d7cb83a None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:35.336309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1eb35-f1c9-4d24-a8a6-3020228740c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:35.336969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1eb35-f1c9-4d24-a8a6-3020228740c0 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:35.337252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1eb35-f1c9-4d24-a8a6-3020228740c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:35.337527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1eb35-f1c9-4d24-a8a6-3020228740c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:35.338241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1eb35-f1c9-4d24-a8a6-3020228740c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:35.338575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1eb35-f1c9-4d24-a8a6-3020228740c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:35.339928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1eb35-f1c9-4d24-a8a6-3020228740c0 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:35.351274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 651/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jun 16 18:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:35.356878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bde137-93a5-4c7a-9020-cae09ccbcf51 None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:35.457420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bde137-93a5-4c7a-9020-cae09ccbcf51 None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:35.471196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:35.492945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6764bf7-8859-493c-8a57-6b6c67290fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:35.493741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764bf7-8859-493c-8a57-6b6c67290fcf None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:35.494025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764bf7-8859-493c-8a57-6b6c67290fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:35.494297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764bf7-8859-493c-8a57-6b6c67290fcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:35.504525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6764bf7-8859-493c-8a57-6b6c67290fcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:35.505980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6764bf7-8859-493c-8a57-6b6c67290fcf None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application [None req-f6764bf7-8859-493c-8a57-6b6c67290fcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 18:40:35.519754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:35.520826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:35.521912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 18:40:35.521912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 18:40:35.521912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 18:40:35.521912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 18:40:35.521912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 18:40:35.521912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 18:40:35.521912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 18:40:35.521912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: ERROR keystone.server.flask.application Jun 16 18:40:35.521912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 634/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jun 16 18:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:35.526748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1eb35-f1c9-4d24-a8a6-3020228740c0 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:35.576201 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:35.626403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1eb35-f1c9-4d24-a8a6-3020228740c0 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:35.659521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb5918-025f-4233-80a2-c9795164f7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:35.660211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5918-025f-4233-80a2-c9795164f7a1 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:35.660495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5918-025f-4233-80a2-c9795164f7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:35.660767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5918-025f-4233-80a2-c9795164f7a1 None admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:35.661547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb5918-025f-4233-80a2-c9795164f7a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:35.661852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb5918-025f-4233-80a2-c9795164f7a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:35.663292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb5918-025f-4233-80a2-c9795164f7a1 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:35.675602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 652/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jun 16 18:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:35.681584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6764bf7-8859-493c-8a57-6b6c67290fcf None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:35.784034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6764bf7-8859-493c-8a57-6b6c67290fcf None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:35.818093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fe4b7-ade9-451c-b242-00291a2b4af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:35.818762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe4b7-ade9-451c-b242-00291a2b4af5 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:35.819043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe4b7-ade9-451c-b242-00291a2b4af5 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:35.819318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe4b7-ade9-451c-b242-00291a2b4af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:35.820138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fe4b7-ade9-451c-b242-00291a2b4af5 None admin] RBAC: Adding query filter params (role.id=4b2eb24a17124a3a903910accd72f5f5, scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287, user.id=167e32465f314f4caf9f8df4a4710dbe) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:35.820446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fe4b7-ade9-451c-b242-00291a2b4af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:35.821872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fe4b7-ade9-451c-b242-00291a2b4af5 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:35.827698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 635/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jun 16 18:40:35 2022] GET /identity/v3/role_assignments?user.id=167e32465f314f4caf9f8df4a4710dbe&scope.project.id=4ce75b1ed5614e5ea2b6cadaed5e3287&role.id=4b2eb24a17124a3a903910accd72f5f5 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:37.958779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f359dc-20ee-417d-9102-aabf0fa2ca80 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:37.959298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f359dc-20ee-417d-9102-aabf0fa2ca80 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:37.959405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f359dc-20ee-417d-9102-aabf0fa2ca80 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:37.960702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 653/1288] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:37.966015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb573-4249-44fe-b463-6bd18e24af64 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:37.966503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb573-4249-44fe-b463-6bd18e24af64 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:37.966621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb573-4249-44fe-b463-6bd18e24af64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:37.983692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-4acbb573-4249-44fe-b463-6bd18e24af64 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:37.984866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4acbb573-4249-44fe-b463-6bd18e24af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:38.013890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:38.052276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 636/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:38.074694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f359dc-20ee-417d-9102-aabf0fa2ca80 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:38.184976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f359dc-20ee-417d-9102-aabf0fa2ca80 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:38.198491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:38.224683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1fac3-3a49-4ecf-b7ae-31629d2dce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:38.225399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1fac3-3a49-4ecf-b7ae-31629d2dce30 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:38.225675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1fac3-3a49-4ecf-b7ae-31629d2dce30 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:38.225947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1fac3-3a49-4ecf-b7ae-31629d2dce30 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:38.226615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1fac3-3a49-4ecf-b7ae-31629d2dce30 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:38.227961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1fac3-3a49-4ecf-b7ae-31629d2dce30 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-7ba1fac3-3a49-4ecf-b7ae-31629d2dce30 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:38.239535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:38.240747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:38.241814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 654/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:40:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:38.246792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb573-4249-44fe-b463-6bd18e24af64 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:38.347667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb573-4249-44fe-b463-6bd18e24af64 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:38.381342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc99b2-4c1e-4964-a55c-36c9ccc09288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:38.381994 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc99b2-4c1e-4964-a55c-36c9ccc09288 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:38.382274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc99b2-4c1e-4964-a55c-36c9ccc09288 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:38.382572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc99b2-4c1e-4964-a55c-36c9ccc09288 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:38.383265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc99b2-4c1e-4964-a55c-36c9ccc09288 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:38.383565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc99b2-4c1e-4964-a55c-36c9ccc09288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:38.384921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc99b2-4c1e-4964-a55c-36c9ccc09288 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:38.389653 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 637/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jun 16 18:40:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:38.395401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1fac3-3a49-4ecf-b7ae-31629d2dce30 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:38.492401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1fac3-3a49-4ecf-b7ae-31629d2dce30 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:38.526128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce81b5-c9b8-48fa-adc2-f6589a530216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:38.526898 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce81b5-c9b8-48fa-adc2-f6589a530216 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:38.527185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce81b5-c9b8-48fa-adc2-f6589a530216 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:38.527462 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce81b5-c9b8-48fa-adc2-f6589a530216 None admin] PATH_INFO: `/v3/services` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:38.528165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce81b5-c9b8-48fa-adc2-f6589a530216 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:38.528473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce81b5-c9b8-48fa-adc2-f6589a530216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:38.529826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce81b5-c9b8-48fa-adc2-f6589a530216 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:38.534249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 655/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jun 16 18:40:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:40:40.629526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8158a96-3d1a-4daf-b62f-38f2191679e3 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:40.630052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8158a96-3d1a-4daf-b62f-38f2191679e3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:40.630052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8158a96-3d1a-4daf-b62f-38f2191679e3 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:40.631470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 638/1293] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:40.636752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6264f2-7099-4091-9f27-2a8159eaa7bd None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:40.637182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6264f2-7099-4091-9f27-2a8159eaa7bd None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:40.637304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6264f2-7099-4091-9f27-2a8159eaa7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:40.653796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-9d6264f2-7099-4091-9f27-2a8159eaa7bd None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:40.655018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9d6264f2-7099-4091-9f27-2a8159eaa7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:40.685343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:40.724562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 656/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 18:40:40.747938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8158a96-3d1a-4daf-b62f-38f2191679e3 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:40.779583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:40.851174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8158a96-3d1a-4daf-b62f-38f2191679e3 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:40.885001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778cca0-d401-45e4-a651-688327a5b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:40.885663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778cca0-d401-45e4-a651-688327a5b50c None admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:40.885944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778cca0-d401-45e4-a651-688327a5b50c None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:40.886217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778cca0-d401-45e4-a651-688327a5b50c None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:40.886966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778cca0-d401-45e4-a651-688327a5b50c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:40.888333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778cca0-d401-45e4-a651-688327a5b50c None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:40.901040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 639/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jun 16 18:40:40 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:40:43.012824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfa948-46a1-47d7-8665-6b31534362d0 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:43.013383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfa948-46a1-47d7-8665-6b31534362d0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:43.013383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfa948-46a1-47d7-8665-6b31534362d0 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:43.014788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 657/1296] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:43.020553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e0ea-1570-403d-afc6-845ead1d126d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:43.020994 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e0ea-1570-403d-afc6-845ead1d126d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:43.021099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e0ea-1570-403d-afc6-845ead1d126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:43.038175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7e57e0ea-1570-403d-afc6-845ead1d126d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:43.039475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7e57e0ea-1570-403d-afc6-845ead1d126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:43.111824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 640/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:43.134317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfa948-46a1-47d7-8665-6b31534362d0 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:43.234246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfa948-46a1-47d7-8665-6b31534362d0 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:43.267257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6dc33-3408-4aa1-8527-5a89c1521bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:43.267975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6dc33-3408-4aa1-8527-5a89c1521bda None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:43.268250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6dc33-3408-4aa1-8527-5a89c1521bda None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:43.269066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6dc33-3408-4aa1-8527-5a89c1521bda None admin] PATH_INFO: `/v3/services/placement` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:43.269716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6dc33-3408-4aa1-8527-5a89c1521bda None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:43.271090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6dc33-3408-4aa1-8527-5a89c1521bda None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-c8f6dc33-3408-4aa1-8527-5a89c1521bda None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:43.282688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:43.283929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:43.284811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 658/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:40:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:43.289897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e0ea-1570-403d-afc6-845ead1d126d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:43.307827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:43.387855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e0ea-1570-403d-afc6-845ead1d126d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:43.421137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4205be1-72f7-440b-9977-0b6a7f70507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:43.421805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205be1-72f7-440b-9977-0b6a7f70507a None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:43.422090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205be1-72f7-440b-9977-0b6a7f70507a None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:43.422368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205be1-72f7-440b-9977-0b6a7f70507a None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:43.423104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4205be1-72f7-440b-9977-0b6a7f70507a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:43.423413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4205be1-72f7-440b-9977-0b6a7f70507a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:43.425383 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4205be1-72f7-440b-9977-0b6a7f70507a None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:43.430606 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 641/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jun 16 18:40:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:43.436458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6dc33-3408-4aa1-8527-5a89c1521bda None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:43.476089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:43.545676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6dc33-3408-4aa1-8527-5a89c1521bda None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:43.578401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b6e3-e1d9-4198-82eb-2bf77683449b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:43.579067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b6e3-e1d9-4198-82eb-2bf77683449b None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:43.579348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b6e3-e1d9-4198-82eb-2bf77683449b None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:43.579618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b6e3-e1d9-4198-82eb-2bf77683449b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:43.580402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b6e3-e1d9-4198-82eb-2bf77683449b None admin] RBAC: Adding query filter params (interface=public, service_id=29e2389f948c45e8bdb8156ce81bade2, region_id=RegionOne) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:43.580711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b6e3-e1d9-4198-82eb-2bf77683449b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:43.582606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b6e3-e1d9-4198-82eb-2bf77683449b None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:43.587702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 659/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jun 16 18:40:43 2022] GET /identity/v3/endpoints?service_id=29e2389f948c45e8bdb8156ce81bade2&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:43.593838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4205be1-72f7-440b-9977-0b6a7f70507a None admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:43.674295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:43.692802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4205be1-72f7-440b-9977-0b6a7f70507a None admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:43.727191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ba341-bf20-4d4c-896f-7df8d60725e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:43.727853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba341-bf20-4d4c-896f-7df8d60725e3 None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:43.728139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba341-bf20-4d4c-896f-7df8d60725e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:43.728419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba341-bf20-4d4c-896f-7df8d60725e3 None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:43.729105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba341-bf20-4d4c-896f-7df8d60725e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:43.730504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba341-bf20-4d4c-896f-7df8d60725e3 None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:43.737427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 642/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jun 16 18:40:43 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:40:45.843064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da930db-7f19-4fed-9e74-4c97263999b1 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:45.843611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da930db-7f19-4fed-9e74-4c97263999b1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:45.843611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da930db-7f19-4fed-9e74-4c97263999b1 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:45.844912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 660/1302] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:40:45.850474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcb032-afb9-41c6-a354-c771b408e5c4 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:45.850911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcb032-afb9-41c6-a354-c771b408e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:45.851033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcb032-afb9-41c6-a354-c771b408e5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:45.867444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-3abcb032-afb9-41c6-a354-c771b408e5c4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:40:45.868612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-3abcb032-afb9-41c6-a354-c771b408e5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:40:45.934862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 643/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:40:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 18:40:45.958709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da930db-7f19-4fed-9e74-4c97263999b1 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:46.052930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:46.060481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da930db-7f19-4fed-9e74-4c97263999b1 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:46.093945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d51a-121d-4804-bcc8-9c63ce745190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:46.094694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d51a-121d-4804-bcc8-9c63ce745190 None admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:46.094978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d51a-121d-4804-bcc8-9c63ce745190 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:46.095253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d51a-121d-4804-bcc8-9c63ce745190 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:46.095897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d51a-121d-4804-bcc8-9c63ce745190 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:46.097793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d51a-121d-4804-bcc8-9c63ce745190 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application [None req-f5c5d51a-121d-4804-bcc8-9c63ce745190 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 18:40:46.109349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 18:40:46.110577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application with Lock( Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self._enter() Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application return self.creator() Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application created_value = creator( Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: ERROR keystone.server.flask.application Jun 16 18:40:46.111438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 661/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jun 16 18:40:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 18:40:46.116623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcb032-afb9-41c6-a354-c771b408e5c4 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:46.197828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:46.221337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcb032-afb9-41c6-a354-c771b408e5c4 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:46.255516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6a1fb-bea6-4704-ae37-60d3f193cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:46.256183 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6a1fb-bea6-4704-ae37-60d3f193cf9d None admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:46.256467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6a1fb-bea6-4704-ae37-60d3f193cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:46.256741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6a1fb-bea6-4704-ae37-60d3f193cf9d None admin] PATH_INFO: `/v3/services` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:46.257444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6a1fb-bea6-4704-ae37-60d3f193cf9d None admin] RBAC: Adding query filter params (name=placement) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:40:46.257751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6a1fb-bea6-4704-ae37-60d3f193cf9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:46.260839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6a1fb-bea6-4704-ae37-60d3f193cf9d None admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:46.264359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 644/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jun 16 18:40:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:40:46.270907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d51a-121d-4804-bcc8-9c63ce745190 None admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:40:46.369296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d51a-121d-4804-bcc8-9c63ce745190 None admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:40:46.402761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bd510-02ed-47ca-8fb4-4def3cf925c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:40:46.403540 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd510-02ed-47ca-8fb4-4def3cf925c9 None admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:40:46.403832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd510-02ed-47ca-8fb4-4def3cf925c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:40:46.404110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd510-02ed-47ca-8fb4-4def3cf925c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:40:46.404849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd510-02ed-47ca-8fb4-4def3cf925c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:40:46.406206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd510-02ed-47ca-8fb4-4def3cf925c9 None admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:40:46.424824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 662/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jun 16 18:40:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:40:56.261262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=30 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:56.420387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:49.602250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafed4b-a16b-41fc-94b9-32d34dde26f6 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:49.602910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafed4b-a16b-41fc-94b9-32d34dde26f6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:49.602910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafed4b-a16b-41fc-94b9-32d34dde26f6 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:49.610444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3130-ae7c-41fd-8cba-b509ef43761f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:49.610871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3130-ae7c-41fd-8cba-b509ef43761f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:49.611067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3130-ae7c-41fd-8cba-b509ef43761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:49.614336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 645/1307] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:41:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:49.710065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-580e3130-ae7c-41fd-8cba-b509ef43761f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:49.711303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-580e3130-ae7c-41fd-8cba-b509ef43761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:49.855065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 663/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:41:49.899370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7806f-7ba5-47b9-9da2-a163a4bf4c54 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:49.899655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7806f-7ba5-47b9-9da2-a163a4bf4c54 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:49.899934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7806f-7ba5-47b9-9da2-a163a4bf4c54 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:49.901306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 646/1309] 10.222.0.40 () {54 vars in 964 bytes} [Thu Jun 16 18:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:49.907911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f50ff2-63b1-4a55-b6ac-5cc8fabdddc0 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:49.908207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f50ff2-63b1-4a55-b6ac-5cc8fabdddc0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:49.908495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f50ff2-63b1-4a55-b6ac-5cc8fabdddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:50.069017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-57f50ff2-63b1-4a55-b6ac-5cc8fabdddc0 None None] MFA Rules not processed for user `e11a8567e1254a0080cbe74efe0127f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:50.070250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-57f50ff2-63b1-4a55-b6ac-5cc8fabdddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:50.111449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:50.191734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 664/1310] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Jun 16 18:41:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:41:50.200457 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7806f-7ba5-47b9-9da2-a163a4bf4c54 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:50.202187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-95e7806f-7ba5-47b9-9da2-a163a4bf4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:50.321420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7806f-7ba5-47b9-9da2-a163a4bf4c54 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:50.409936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7bf6b-060c-4108-84c2-2e2d13ecb217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:50.410965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bf6b-060c-4108-84c2-2e2d13ecb217 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:50.411427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bf6b-060c-4108-84c2-2e2d13ecb217 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:50.411892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bf6b-060c-4108-84c2-2e2d13ecb217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:50.413931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-32b7bf6b-060c-4108-84c2-2e2d13ecb217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:50.473054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:50.553014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7bf6b-060c-4108-84c2-2e2d13ecb217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:50.554603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7bf6b-060c-4108-84c2-2e2d13ecb217 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:50.579748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 647/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:41:53.022734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d5d7e-2185-4364-9ac3-29d391b8745a None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:53.023299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d5d7e-2185-4364-9ac3-29d391b8745a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:53.023299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d5d7e-2185-4364-9ac3-29d391b8745a None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:53.024675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 665/1312] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:53.029933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca94f-8d38-442d-96db-3d3bf07ab619 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:53.030336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca94f-8d38-442d-96db-3d3bf07ab619 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:53.030557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca94f-8d38-442d-96db-3d3bf07ab619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:53.101525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7e5ca94f-8d38-442d-96db-3d3bf07ab619 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:53.102733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7e5ca94f-8d38-442d-96db-3d3bf07ab619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:53.202186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 648/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:41:53.242243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d5d7e-2185-4364-9ac3-29d391b8745a None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:53.243822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b30d5d7e-2185-4364-9ac3-29d391b8745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:53.349795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d5d7e-2185-4364-9ac3-29d391b8745a None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:53.427426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:53.430538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c1266-b16b-403d-a9c4-4614d299339e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:53.431385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c1266-b16b-403d-a9c4-4614d299339e service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:53.431687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c1266-b16b-403d-a9c4-4614d299339e service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:53.432373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c1266-b16b-403d-a9c4-4614d299339e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:53.434265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6b1c1266-b16b-403d-a9c4-4614d299339e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:53.552250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c1266-b16b-403d-a9c4-4614d299339e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:53.553681 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c1266-b16b-403d-a9c4-4614d299339e service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:53.572994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 666/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:41:56.016311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00337d0a-7895-487b-bc24-ea8ad8b51263 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:56.016870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00337d0a-7895-487b-bc24-ea8ad8b51263 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:56.016870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00337d0a-7895-487b-bc24-ea8ad8b51263 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:56.018253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 649/1315] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:56.023434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39280b0c-29e9-4769-9f5b-de2f5a51a089 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:56.023839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39280b0c-29e9-4769-9f5b-de2f5a51a089 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:56.023987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39280b0c-29e9-4769-9f5b-de2f5a51a089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:56.087052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-39280b0c-29e9-4769-9f5b-de2f5a51a089 None None] MFA Rules not processed for user `b03aa99594304e7f8e065f8b3ac2b405`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:56.088185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-39280b0c-29e9-4769-9f5b-de2f5a51a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:56.139576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:56.183393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 667/1316] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:41:56.222802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00337d0a-7895-487b-bc24-ea8ad8b51263 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:56.224432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-00337d0a-7895-487b-bc24-ea8ad8b51263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:56.234795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:56.327308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00337d0a-7895-487b-bc24-ea8ad8b51263 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:56.399165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd217b4-eb4b-4335-b9b7-14faae09506f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:56.399738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd217b4-eb4b-4335-b9b7-14faae09506f service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:56.400019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd217b4-eb4b-4335-b9b7-14faae09506f service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:56.400294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd217b4-eb4b-4335-b9b7-14faae09506f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:56.401920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2cd217b4-eb4b-4335-b9b7-14faae09506f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:56.463365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:56.510321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd217b4-eb4b-4335-b9b7-14faae09506f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:56.511784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd217b4-eb4b-4335-b9b7-14faae09506f service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:56.529656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 650/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:41:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:41:59.175304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5af38f-8bfd-47a9-83aa-147ee991abc9 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:59.175845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5af38f-8bfd-47a9-83aa-147ee991abc9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:59.175845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5af38f-8bfd-47a9-83aa-147ee991abc9 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:59.177234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 668/1318] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:41:59.182335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28c4a9-53ab-4e04-87d8-f3237cbfe92a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:59.182799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28c4a9-53ab-4e04-87d8-f3237cbfe92a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:59.182925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28c4a9-53ab-4e04-87d8-f3237cbfe92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:59.246672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ff28c4a9-53ab-4e04-87d8-f3237cbfe92a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:41:59.247862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ff28c4a9-53ab-4e04-87d8-f3237cbfe92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:59.348154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 651/1319] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:41:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:41:59.386464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5af38f-8bfd-47a9-83aa-147ee991abc9 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:41:59.388016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1a5af38f-8bfd-47a9-83aa-147ee991abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:59.491045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5af38f-8bfd-47a9-83aa-147ee991abc9 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:41:59.563956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0b7b8-8be3-4195-9f73-a6d92da1ff78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:41:59.564598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b7b8-8be3-4195-9f73-a6d92da1ff78 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:41:59.564877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b7b8-8be3-4195-9f73-a6d92da1ff78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:41:59.565154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b7b8-8be3-4195-9f73-a6d92da1ff78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:41:59.566809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a5f0b7b8-8be3-4195-9f73-a6d92da1ff78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:41:59.574093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:59.673355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0b7b8-8be3-4195-9f73-a6d92da1ff78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:41:59.674812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0b7b8-8be3-4195-9f73-a6d92da1ff78 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:41:59.692751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 669/1320] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:41:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:02.529315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d73d07-1e79-4deb-857d-6c4f755bd073 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:02.529918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d73d07-1e79-4deb-857d-6c4f755bd073 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:02.529918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d73d07-1e79-4deb-857d-6c4f755bd073 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:02.531312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 652/1321] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:02.537211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f5768-dd3f-4f20-9f1f-a32d4063f6fa None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:02.537775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f5768-dd3f-4f20-9f1f-a32d4063f6fa None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:02.537775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f5768-dd3f-4f20-9f1f-a32d4063f6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:02.608913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-562f5768-dd3f-4f20-9f1f-a32d4063f6fa None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:02.610133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-562f5768-dd3f-4f20-9f1f-a32d4063f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:02.671523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:02.712845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 670/1322] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:02.748500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d73d07-1e79-4deb-857d-6c4f755bd073 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:02.750574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f1d73d07-1e79-4deb-857d-6c4f755bd073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:02.770226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:02.854228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d73d07-1e79-4deb-857d-6c4f755bd073 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:02.926037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292a724-7040-4497-8fa8-648f291e67a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:02.926628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292a724-7040-4497-8fa8-648f291e67a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:02.926909 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292a724-7040-4497-8fa8-648f291e67a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:02.927182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292a724-7040-4497-8fa8-648f291e67a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:02.928798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d292a724-7040-4497-8fa8-648f291e67a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:03.005189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:03.043244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292a724-7040-4497-8fa8-648f291e67a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:03.044607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292a724-7040-4497-8fa8-648f291e67a1 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:03.063362 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 653/1323] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:05.247512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1a044-7ab6-4c84-95ed-b4cc2532c3c3 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:05.248054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1a044-7ab6-4c84-95ed-b4cc2532c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:05.248054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1a044-7ab6-4c84-95ed-b4cc2532c3c3 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:05.249971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 671/1324] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:05.255327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3ddb2-38be-4d6a-89b9-31d52bb3a1b2 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:05.255730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3ddb2-38be-4d6a-89b9-31d52bb3a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:05.255886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3ddb2-38be-4d6a-89b9-31d52bb3a1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:05.324485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-59d3ddb2-38be-4d6a-89b9-31d52bb3a1b2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:05.325691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-59d3ddb2-38be-4d6a-89b9-31d52bb3a1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:05.424580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 654/1325] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:05.460676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1a044-7ab6-4c84-95ed-b4cc2532c3c3 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:05.462240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-66d1a044-7ab6-4c84-95ed-b4cc2532c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:05.572093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1a044-7ab6-4c84-95ed-b4cc2532c3c3 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:05.657399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead91a8f-b519-4f44-b257-828f332a5cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:05.658069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91a8f-b519-4f44-b257-828f332a5cfe service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:05.658353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91a8f-b519-4f44-b257-828f332a5cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:05.658670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91a8f-b519-4f44-b257-828f332a5cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:05.660404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ead91a8f-b519-4f44-b257-828f332a5cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:05.678598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:05.773662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead91a8f-b519-4f44-b257-828f332a5cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:05.775055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead91a8f-b519-4f44-b257-828f332a5cfe service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:05.794310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 672/1326] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:07.975414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2643aa-9d9b-4e81-9aef-4a211224feb8 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:07.975968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2643aa-9d9b-4e81-9aef-4a211224feb8 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:07.975968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2643aa-9d9b-4e81-9aef-4a211224feb8 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:07.978817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 655/1327] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:07.983003 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7ae34-32c5-4f89-bec8-447b96788dec None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:07.983473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7ae34-32c5-4f89-bec8-447b96788dec None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:07.983574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7ae34-32c5-4f89-bec8-447b96788dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:08.049177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-2ea7ae34-32c5-4f89-bec8-447b96788dec None None] MFA Rules not processed for user `b03aa99594304e7f8e065f8b3ac2b405`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:08.050396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2ea7ae34-32c5-4f89-bec8-447b96788dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:08.117264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:08.170840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 673/1328] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:08.200520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2643aa-9d9b-4e81-9aef-4a211224feb8 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:08.202149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-be2643aa-9d9b-4e81-9aef-4a211224feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:08.236028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:08.312369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2643aa-9d9b-4e81-9aef-4a211224feb8 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:08.387492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4ce34-4aac-4a17-92f6-4fdc274c8c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:08.388134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4ce34-4aac-4a17-92f6-4fdc274c8c2a service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:08.388415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4ce34-4aac-4a17-92f6-4fdc274c8c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:08.388689 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4ce34-4aac-4a17-92f6-4fdc274c8c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:08.390347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1df4ce34-4aac-4a17-92f6-4fdc274c8c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:08.466858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:08.498510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4ce34-4aac-4a17-92f6-4fdc274c8c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:08.500502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4ce34-4aac-4a17-92f6-4fdc274c8c2a service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:08.518743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 656/1329] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:10.894084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869a56-1a91-410c-ab4e-e859d6dcf875 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:10.894658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869a56-1a91-410c-ab4e-e859d6dcf875 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:10.894658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869a56-1a91-410c-ab4e-e859d6dcf875 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:10.895979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 674/1330] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:10.900984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907f35-fdd0-4fbe-b50c-96f7c5fd7a70 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:10.901392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907f35-fdd0-4fbe-b50c-96f7c5fd7a70 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:10.901546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907f35-fdd0-4fbe-b50c-96f7c5fd7a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:10.965918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-6e907f35-fdd0-4fbe-b50c-96f7c5fd7a70 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:10.967134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6e907f35-fdd0-4fbe-b50c-96f7c5fd7a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:11.062459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 657/1331] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:11.098715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd869a56-1a91-410c-ab4e-e859d6dcf875 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:11.100241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dd869a56-1a91-410c-ab4e-e859d6dcf875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:11.201666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd869a56-1a91-410c-ab4e-e859d6dcf875 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:11.274853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c3234-4b2a-43e6-9e3d-6de4cdd6aa7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:11.275499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c3234-4b2a-43e6-9e3d-6de4cdd6aa7f service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:11.275779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c3234-4b2a-43e6-9e3d-6de4cdd6aa7f service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:11.276055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c3234-4b2a-43e6-9e3d-6de4cdd6aa7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:11.277686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-207c3234-4b2a-43e6-9e3d-6de4cdd6aa7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:11.306933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:11.389849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c3234-4b2a-43e6-9e3d-6de4cdd6aa7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:11.391292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c3234-4b2a-43e6-9e3d-6de4cdd6aa7f service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:11.409533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 675/1332] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:13.578722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9f228-01ac-45b8-bc6c-736ae6768e3d None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:13.579246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9f228-01ac-45b8-bc6c-736ae6768e3d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:13.579367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9f228-01ac-45b8-bc6c-736ae6768e3d None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:13.580628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 658/1333] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:13.585789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e26e9-664a-4ca6-9856-3d9e140bce0b None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:13.586184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e26e9-664a-4ca6-9856-3d9e140bce0b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:13.586345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e26e9-664a-4ca6-9856-3d9e140bce0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:13.649133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-9b9e26e9-664a-4ca6-9856-3d9e140bce0b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:13.650307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9b9e26e9-664a-4ca6-9856-3d9e140bce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:13.722943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:13.745344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 676/1334] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:13.799994 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ff6bb-cc24-4231-91f9-0bdf7600404a None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:13.800279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ff6bb-cc24-4231-91f9-0bdf7600404a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:13.800554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ff6bb-cc24-4231-91f9-0bdf7600404a None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:13.801963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 659/1335] 10.222.0.40 () {54 vars in 964 bytes} [Thu Jun 16 18:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:13.808177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1a03e-0b3d-4f7b-ab57-f341ade3e0bd None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:13.808465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1a03e-0b3d-4f7b-ab57-f341ade3e0bd None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:13.808740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1a03e-0b3d-4f7b-ab57-f341ade3e0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:13.882328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b8d1a03e-0b3d-4f7b-ab57-f341ade3e0bd None None] MFA Rules not processed for user `e11a8567e1254a0080cbe74efe0127f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:13.883542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b8d1a03e-0b3d-4f7b-ab57-f341ade3e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:13.959093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 677/1336] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Jun 16 18:42:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:13.968820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ff6bb-cc24-4231-91f9-0bdf7600404a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:13.970341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-9d7ff6bb-cc24-4231-91f9-0bdf7600404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:14.010215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:14.073297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ff6bb-cc24-4231-91f9-0bdf7600404a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:14.147939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb927e-978b-4cdc-a70c-7d0f4fbcedf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:14.148588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb927e-978b-4cdc-a70c-7d0f4fbcedf6 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:14.148869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb927e-978b-4cdc-a70c-7d0f4fbcedf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:14.149142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb927e-978b-4cdc-a70c-7d0f4fbcedf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:14.150805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dedb927e-978b-4cdc-a70c-7d0f4fbcedf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:14.232495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:14.258356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb927e-978b-4cdc-a70c-7d0f4fbcedf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:14.259854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb927e-978b-4cdc-a70c-7d0f4fbcedf6 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:14.277507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 660/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:17.259221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383dc9b-39d1-4880-abfb-1a8f5280a9dc None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:17.259790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383dc9b-39d1-4880-abfb-1a8f5280a9dc None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:17.259790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383dc9b-39d1-4880-abfb-1a8f5280a9dc None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:17.261148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 678/1338] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:17.266358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9af918-3732-4e0a-878b-6db25466058b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:17.266787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9af918-3732-4e0a-878b-6db25466058b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:17.266934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9af918-3732-4e0a-878b-6db25466058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:17.332184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-dd9af918-3732-4e0a-878b-6db25466058b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:17.333370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dd9af918-3732-4e0a-878b-6db25466058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:17.427722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 661/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:17.464029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383dc9b-39d1-4880-abfb-1a8f5280a9dc None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:17.465531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7383dc9b-39d1-4880-abfb-1a8f5280a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:17.546026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:17.574017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383dc9b-39d1-4880-abfb-1a8f5280a9dc None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:17.643987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996be98-ae82-4e8a-92ac-46824a8eae19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:17.644625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996be98-ae82-4e8a-92ac-46824a8eae19 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:17.644902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996be98-ae82-4e8a-92ac-46824a8eae19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:17.645175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996be98-ae82-4e8a-92ac-46824a8eae19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:17.646817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0996be98-ae82-4e8a-92ac-46824a8eae19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:17.752602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996be98-ae82-4e8a-92ac-46824a8eae19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:17.754021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996be98-ae82-4e8a-92ac-46824a8eae19 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:17.771857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 679/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:21.968321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9060e-655f-45f0-9b2c-2d17a1d36bdd None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:21.968840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9060e-655f-45f0-9b2c-2d17a1d36bdd None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:21.968936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9060e-655f-45f0-9b2c-2d17a1d36bdd None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:21.970244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 662/1341] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:21.975811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6cda4-ab83-42e7-b45d-885c5fa34178 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:21.976253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6cda4-ab83-42e7-b45d-885c5fa34178 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:21.976504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6cda4-ab83-42e7-b45d-885c5fa34178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:21.983168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:22.050365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-13f6cda4-ab83-42e7-b45d-885c5fa34178 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:22.051650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-13f6cda4-ab83-42e7-b45d-885c5fa34178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:22.162788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 680/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:22.201285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9060e-655f-45f0-9b2c-2d17a1d36bdd None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:22.204061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f6a9060e-655f-45f0-9b2c-2d17a1d36bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:22.256126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:22.302899 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9060e-655f-45f0-9b2c-2d17a1d36bdd None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:22.306484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87302bf5-8b32-413b-a44b-053969d4af93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:22.307137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87302bf5-8b32-413b-a44b-053969d4af93 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:22.307421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87302bf5-8b32-413b-a44b-053969d4af93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:22.307701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87302bf5-8b32-413b-a44b-053969d4af93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:22.317693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87302bf5-8b32-413b-a44b-053969d4af93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:22.319170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87302bf5-8b32-413b-a44b-053969d4af93 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:22.329221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 663/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:25.036332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06001853-9985-4ef2-b16d-fca65f3b4451 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:25.036871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06001853-9985-4ef2-b16d-fca65f3b4451 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:25.036871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06001853-9985-4ef2-b16d-fca65f3b4451 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:25.038238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 681/1344] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:25.043561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014673e-3f91-42eb-a4ca-32ce5e08f883 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:25.044006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014673e-3f91-42eb-a4ca-32ce5e08f883 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:25.044118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014673e-3f91-42eb-a4ca-32ce5e08f883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:25.074244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-3014673e-3f91-42eb-a4ca-32ce5e08f883 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:25.075522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-3014673e-3f91-42eb-a4ca-32ce5e08f883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:25.171598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 664/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:25.204942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06001853-9985-4ef2-b16d-fca65f3b4451 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:25.215979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06001853-9985-4ef2-b16d-fca65f3b4451 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:25.220238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96aec45-3124-473c-af76-5570f4e8f072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:25.220901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96aec45-3124-473c-af76-5570f4e8f072 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:25.221185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96aec45-3124-473c-af76-5570f4e8f072 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:25.221467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96aec45-3124-473c-af76-5570f4e8f072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:25.231284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96aec45-3124-473c-af76-5570f4e8f072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:25.233287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96aec45-3124-473c-af76-5570f4e8f072 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:25.242874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 682/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:29.554627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c18f-a477-4e31-ab12-0b9bee6fe223 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:29.555258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c18f-a477-4e31-ab12-0b9bee6fe223 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:29.555258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878c18f-a477-4e31-ab12-0b9bee6fe223 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:29.556545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 665/1347] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:29.562059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a7aa2-5a02-4b16-a248-130d928bb1f4 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:29.562498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a7aa2-5a02-4b16-a248-130d928bb1f4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:29.562649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a7aa2-5a02-4b16-a248-130d928bb1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:29.581605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-148a7aa2-5a02-4b16-a248-130d928bb1f4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:29.582880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-148a7aa2-5a02-4b16-a248-130d928bb1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:29.590772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 683/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:29.628376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c18f-a477-4e31-ab12-0b9bee6fe223 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:29.639294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878c18f-a477-4e31-ab12-0b9bee6fe223 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:29.642818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a652be-a2b0-4dcf-98f6-5c3102ec6c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:29.643444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a652be-a2b0-4dcf-98f6-5c3102ec6c08 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:29.643719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a652be-a2b0-4dcf-98f6-5c3102ec6c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:29.643992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a652be-a2b0-4dcf-98f6-5c3102ec6c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:29.653434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a652be-a2b0-4dcf-98f6-5c3102ec6c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:29.655435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a652be-a2b0-4dcf-98f6-5c3102ec6c08 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:29.665269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 666/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:34.713844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b73576-bd81-4ddb-8442-2d0525ab8583 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:34.714435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b73576-bd81-4ddb-8442-2d0525ab8583 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:34.714435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b73576-bd81-4ddb-8442-2d0525ab8583 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:34.716198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 684/1350] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:42:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:34.721296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee00392-4690-4030-a305-bb01343c3175 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:34.722072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee00392-4690-4030-a305-bb01343c3175 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:34.722617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee00392-4690-4030-a305-bb01343c3175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:34.806287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-bee00392-4690-4030-a305-bb01343c3175 None None] MFA Rules not processed for user `167e32465f314f4caf9f8df4a4710dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:34.807509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-bee00392-4690-4030-a305-bb01343c3175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:34.837280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:34.900620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 667/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:42:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:39.094630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f9751-d890-4604-ae4b-6a26fed36a1f None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:39.095162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f9751-d890-4604-ae4b-6a26fed36a1f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:39.095273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f9751-d890-4604-ae4b-6a26fed36a1f None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:39.096746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 685/1352] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:39.101823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b53b7-8511-422d-b388-2516553b52df None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:39.102297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b53b7-8511-422d-b388-2516553b52df None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:39.102425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b53b7-8511-422d-b388-2516553b52df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:39.122556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-205b53b7-8511-422d-b388-2516553b52df None None] MFA Rules not processed for user `167e32465f314f4caf9f8df4a4710dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:39.124249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-205b53b7-8511-422d-b388-2516553b52df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:39.132965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 668/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:42:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:39.576272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=72 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:40.619366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766a5c1-d34e-4b3d-a7c8-4c961a51d505 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:40.619986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766a5c1-d34e-4b3d-a7c8-4c961a51d505 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:40.619986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766a5c1-d34e-4b3d-a7c8-4c961a51d505 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:40.621308 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 686/1354] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:40.626218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30af6-62cf-407e-bc55-c150866df623 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:40.626657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30af6-62cf-407e-bc55-c150866df623 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:40.626933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30af6-62cf-407e-bc55-c150866df623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:40.645574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2df30af6-62cf-407e-bc55-c150866df623 None None] MFA Rules not processed for user `167e32465f314f4caf9f8df4a4710dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:40.646820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2df30af6-62cf-407e-bc55-c150866df623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:40.656147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 669/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:42:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:42:44.415864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d248-f359-45b9-afbf-58de077a8fa9 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:44.416734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d248-f359-45b9-afbf-58de077a8fa9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:44.417008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9d248-f359-45b9-afbf-58de077a8fa9 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:44.418728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 687/1356] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:42:44.424038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c60cc-80d6-44b9-bfba-56542d7b1cdb None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:44.425018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c60cc-80d6-44b9-bfba-56542d7b1cdb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:44.425300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c60cc-80d6-44b9-bfba-56542d7b1cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:44.443398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-177c60cc-80d6-44b9-bfba-56542d7b1cdb None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:44.444588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-177c60cc-80d6-44b9-bfba-56542d7b1cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:44.452901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 670/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:44.508206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0a08-d453-4a93-aba9-bec254c4fb19 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:44.508691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0a08-d453-4a93-aba9-bec254c4fb19 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:44.509041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a0a08-d453-4a93-aba9-bec254c4fb19 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:44.510734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 688/1358] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jun 16 18:42:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:44.518730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3627-c394-4a7b-9d39-82d543354702 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:44.519164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3627-c394-4a7b-9d39-82d543354702 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:44.519658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af3627-c394-4a7b-9d39-82d543354702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:44.581834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c0af3627-c394-4a7b-9d39-82d543354702 None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:44.583178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c0af3627-c394-4a7b-9d39-82d543354702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:44.679241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 671/1359] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jun 16 18:42:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:42:44.687817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a0a08-d453-4a93-aba9-bec254c4fb19 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:44.702739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a0a08-d453-4a93-aba9-bec254c4fb19 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:44.708180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b268c4-bc6d-4229-b996-5c6c82cc524e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:44.708991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b268c4-bc6d-4229-b996-5c6c82cc524e service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:44.709446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b268c4-bc6d-4229-b996-5c6c82cc524e service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:44.709883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b268c4-bc6d-4229-b996-5c6c82cc524e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:44.719035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b268c4-bc6d-4229-b996-5c6c82cc524e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:44.720789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b268c4-bc6d-4229-b996-5c6c82cc524e service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:44.730941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 689/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:47.067876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f2ce-284a-41f4-b51f-4839cb058d8b None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:47.068437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f2ce-284a-41f4-b51f-4839cb058d8b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:47.068437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6f2ce-284a-41f4-b51f-4839cb058d8b None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:47.069987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 672/1361] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:42:47.076222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23238c-4dad-4f4f-82ae-a24a7839f3a0 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:47.076831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23238c-4dad-4f4f-82ae-a24a7839f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:47.076831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23238c-4dad-4f4f-82ae-a24a7839f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:47.096102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-bb23238c-4dad-4f4f-82ae-a24a7839f3a0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:47.097336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bb23238c-4dad-4f4f-82ae-a24a7839f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:47.105450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 690/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:47.151268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6f2ce-284a-41f4-b51f-4839cb058d8b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:47.168462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6f2ce-284a-41f4-b51f-4839cb058d8b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:47.178588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312682-e217-4be2-a970-8eb55da124cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:47.179246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312682-e217-4be2-a970-8eb55da124cb service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:47.179527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312682-e217-4be2-a970-8eb55da124cb service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:47.179807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312682-e217-4be2-a970-8eb55da124cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:47.189353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312682-e217-4be2-a970-8eb55da124cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:47.191003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312682-e217-4be2-a970-8eb55da124cb service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:47.201177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 673/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:49.679832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de614304-fcd1-4a69-a5d4-3323fadd392a None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:49.680382 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de614304-fcd1-4a69-a5d4-3323fadd392a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:49.680382 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de614304-fcd1-4a69-a5d4-3323fadd392a None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:49.681757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 691/1364] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:49.687441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ebb69-d776-4a6b-8345-4eacff9c4e4d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:49.687843 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ebb69-d776-4a6b-8345-4eacff9c4e4d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:49.687999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ebb69-d776-4a6b-8345-4eacff9c4e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:49.712088 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-021ebb69-d776-4a6b-8345-4eacff9c4e4d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:49.713316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-021ebb69-d776-4a6b-8345-4eacff9c4e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:49.721992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 674/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:49.766937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60427ebb-89a6-46ee-97a9-74eb5a5709a9 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:49.767344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60427ebb-89a6-46ee-97a9-74eb5a5709a9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:49.767747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60427ebb-89a6-46ee-97a9-74eb5a5709a9 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:49.769300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 692/1366] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jun 16 18:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:49.775137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d51310-fdef-45e3-9ed9-58598fee6c02 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:49.775428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d51310-fdef-45e3-9ed9-58598fee6c02 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:49.775710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d51310-fdef-45e3-9ed9-58598fee6c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:49.795984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f4d51310-fdef-45e3-9ed9-58598fee6c02 None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:49.797183 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f4d51310-fdef-45e3-9ed9-58598fee6c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:49.806620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 675/1367] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jun 16 18:42:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:42:49.814980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60427ebb-89a6-46ee-97a9-74eb5a5709a9 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:49.831531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60427ebb-89a6-46ee-97a9-74eb5a5709a9 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:49.837360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbf61f-ee88-428b-b17e-d154dccb6bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:49.838288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbf61f-ee88-428b-b17e-d154dccb6bdb service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:49.838789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbf61f-ee88-428b-b17e-d154dccb6bdb service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:49.839261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbf61f-ee88-428b-b17e-d154dccb6bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:49.848685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbf61f-ee88-428b-b17e-d154dccb6bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:49.850268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbf61f-ee88-428b-b17e-d154dccb6bdb service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:49.859823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 693/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:52.078833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b3e21-9594-443c-b8d3-411c3d28eb84 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:52.079376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b3e21-9594-443c-b8d3-411c3d28eb84 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:52.079376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b3e21-9594-443c-b8d3-411c3d28eb84 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:52.080734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 676/1369] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:52.086066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb945d6d-6817-486b-9999-05b347d29453 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:52.086521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb945d6d-6817-486b-9999-05b347d29453 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:52.086661 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb945d6d-6817-486b-9999-05b347d29453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:52.104509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-fb945d6d-6817-486b-9999-05b347d29453 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:52.105694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-fb945d6d-6817-486b-9999-05b347d29453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:52.114241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 694/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:52.159089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b3e21-9594-443c-b8d3-411c3d28eb84 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:52.177506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b3e21-9594-443c-b8d3-411c3d28eb84 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:52.184779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4785d-dc47-4095-8bfd-076cc653acfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:52.185860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4785d-dc47-4095-8bfd-076cc653acfd service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:52.186633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4785d-dc47-4095-8bfd-076cc653acfd service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:52.187118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4785d-dc47-4095-8bfd-076cc653acfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:52.198852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4785d-dc47-4095-8bfd-076cc653acfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:52.201055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4785d-dc47-4095-8bfd-076cc653acfd service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:52.211520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 677/1371] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:52.562150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dd05c-2e2d-40b8-aa5b-04ce6cbd13c2 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:52.562534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dd05c-2e2d-40b8-aa5b-04ce6cbd13c2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:52.562721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dd05c-2e2d-40b8-aa5b-04ce6cbd13c2 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:52.564084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 695/1372] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:52.569409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdff04-4c11-4a42-94e7-fa86ff6c8019 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:52.569698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdff04-4c11-4a42-94e7-fa86ff6c8019 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:52.569972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdff04-4c11-4a42-94e7-fa86ff6c8019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:52.588929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a0cdff04-4c11-4a42-94e7-fa86ff6c8019 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:52.590470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a0cdff04-4c11-4a42-94e7-fa86ff6c8019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:52.603961 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 678/1373] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:52.902071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cf203-0aca-4710-a2a3-fd48ce08b136 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:52.902071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cf203-0aca-4710-a2a3-fd48ce08b136 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:52.902071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cf203-0aca-4710-a2a3-fd48ce08b136 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:52.902969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 696/1374] 10.222.0.40 () {54 vars in 963 bytes} [Thu Jun 16 18:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:52.909267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458c739-c481-4678-a2ca-64dd163d3d10 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:52.909557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458c739-c481-4678-a2ca-64dd163d3d10 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:52.909833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458c739-c481-4678-a2ca-64dd163d3d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:52.917892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:52.964846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a458c739-c481-4678-a2ca-64dd163d3d10 None None] MFA Rules not processed for user `387fd99ff326463698bc32947ba25d77`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:52.966946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a458c739-c481-4678-a2ca-64dd163d3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:53.035758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 679/1375] 10.222.0.40 () {58 vars in 1060 bytes} [Thu Jun 16 18:42:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:53.042885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cf203-0aca-4710-a2a3-fd48ce08b136 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:53.054717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cf203-0aca-4710-a2a3-fd48ce08b136 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:53.058563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c757bf-7d5a-4d94-bb25-675ef21cb75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:53.060263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c757bf-7d5a-4d94-bb25-675ef21cb75e service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:53.060748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c757bf-7d5a-4d94-bb25-675ef21cb75e service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:53.070217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c757bf-7d5a-4d94-bb25-675ef21cb75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:53.084530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c757bf-7d5a-4d94-bb25-675ef21cb75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:53.086232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c757bf-7d5a-4d94-bb25-675ef21cb75e service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:53.096951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 697/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:54.383361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9add6de-a343-4582-b558-67a292884632 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:54.383911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9add6de-a343-4582-b558-67a292884632 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:54.383911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9add6de-a343-4582-b558-67a292884632 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:54.385270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 680/1377] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:54.391010 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c836b90-5401-4e7b-9de7-8f430dcf926b None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:54.391420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c836b90-5401-4e7b-9de7-8f430dcf926b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:54.391635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c836b90-5401-4e7b-9de7-8f430dcf926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:54.409509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-6c836b90-5401-4e7b-9de7-8f430dcf926b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:54.410738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6c836b90-5401-4e7b-9de7-8f430dcf926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:54.419089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 698/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:54.463097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9add6de-a343-4582-b558-67a292884632 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:54.478108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9add6de-a343-4582-b558-67a292884632 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:54.483559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0daff0-0fb6-4bfb-a80c-acf719ba4f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:54.484259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0daff0-0fb6-4bfb-a80c-acf719ba4f34 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:54.484606 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0daff0-0fb6-4bfb-a80c-acf719ba4f34 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:54.484943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0daff0-0fb6-4bfb-a80c-acf719ba4f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:54.493192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0daff0-0fb6-4bfb-a80c-acf719ba4f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:54.494927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0daff0-0fb6-4bfb-a80c-acf719ba4f34 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:54.505299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 681/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:56.687379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed50a30-e8ee-4fd4-bae5-44d6cde391d5 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:56.687882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed50a30-e8ee-4fd4-bae5-44d6cde391d5 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:56.688338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed50a30-e8ee-4fd4-bae5-44d6cde391d5 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:56.690164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 699/1380] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:42:56.695815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e438-838e-4827-a08d-5f13e2daf8a1 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:56.696295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e438-838e-4827-a08d-5f13e2daf8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:56.696410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e438-838e-4827-a08d-5f13e2daf8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:56.714750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-5948e438-838e-4827-a08d-5f13e2daf8a1 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:56.715991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5948e438-838e-4827-a08d-5f13e2daf8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:56.723914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 682/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:56.767950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed50a30-e8ee-4fd4-bae5-44d6cde391d5 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:56.803197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed50a30-e8ee-4fd4-bae5-44d6cde391d5 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:56.808909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bc1d1-8bc6-43cc-a746-5e1f5789222a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:56.809823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bc1d1-8bc6-43cc-a746-5e1f5789222a service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:56.811309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bc1d1-8bc6-43cc-a746-5e1f5789222a service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:56.811941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bc1d1-8bc6-43cc-a746-5e1f5789222a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:56.821205 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bc1d1-8bc6-43cc-a746-5e1f5789222a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:56.823018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bc1d1-8bc6-43cc-a746-5e1f5789222a service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:56.833181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 700/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:42:59.078422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9344251-542c-48ba-b272-89cf645f6275 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:59.079276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9344251-542c-48ba-b272-89cf645f6275 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:59.079733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9344251-542c-48ba-b272-89cf645f6275 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:59.081090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 683/1383] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:42:59.086315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67a4ec-051e-4c0c-a3ed-bca40c0624d4 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:59.086775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67a4ec-051e-4c0c-a3ed-bca40c0624d4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:59.086888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67a4ec-051e-4c0c-a3ed-bca40c0624d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:59.105008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-7b67a4ec-051e-4c0c-a3ed-bca40c0624d4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:42:59.106217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7b67a4ec-051e-4c0c-a3ed-bca40c0624d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:42:59.115461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 701/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:42:59.166361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9344251-542c-48ba-b272-89cf645f6275 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:42:59.181388 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9344251-542c-48ba-b272-89cf645f6275 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:42:59.187730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb80805-8661-4512-b707-6aaf5532f0e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:42:59.188490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb80805-8661-4512-b707-6aaf5532f0e0 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:42:59.188870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb80805-8661-4512-b707-6aaf5532f0e0 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:42:59.189240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb80805-8661-4512-b707-6aaf5532f0e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:42:59.198353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb80805-8661-4512-b707-6aaf5532f0e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:42:59.200746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb80805-8661-4512-b707-6aaf5532f0e0 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:42:59.210824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 684/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:01.409710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88328a-7db6-4294-a9fc-05f59e3efd8d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:01.410288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88328a-7db6-4294-a9fc-05f59e3efd8d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:01.410469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88328a-7db6-4294-a9fc-05f59e3efd8d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:01.412299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 702/1386] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:01.418927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a0e14-bdfb-41a1-988f-bdf9b256325f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:01.419542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a0e14-bdfb-41a1-988f-bdf9b256325f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:01.419676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a0e14-bdfb-41a1-988f-bdf9b256325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:01.441677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-759a0e14-bdfb-41a1-988f-bdf9b256325f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:01.443199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-759a0e14-bdfb-41a1-988f-bdf9b256325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:01.452993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 685/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:43:01.498854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88328a-7db6-4294-a9fc-05f59e3efd8d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:01.516973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88328a-7db6-4294-a9fc-05f59e3efd8d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:01.524002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67272c-9ad6-4d83-8cc5-0e94ed35bdad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:01.524773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67272c-9ad6-4d83-8cc5-0e94ed35bdad service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:01.525127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67272c-9ad6-4d83-8cc5-0e94ed35bdad service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:01.525462 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67272c-9ad6-4d83-8cc5-0e94ed35bdad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:01.537052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67272c-9ad6-4d83-8cc5-0e94ed35bdad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:01.539115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67272c-9ad6-4d83-8cc5-0e94ed35bdad service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:01.552426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 703/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:03.820343 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f0441-862e-43bb-a3ba-72c3c6383809 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:03.820947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f0441-862e-43bb-a3ba-72c3c6383809 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:03.821054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f0441-862e-43bb-a3ba-72c3c6383809 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:03.822580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 686/1389] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:43:03.829257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0120f5-1a12-4a78-a287-a4f2a67f892c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:03.829760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0120f5-1a12-4a78-a287-a4f2a67f892c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:03.829985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0120f5-1a12-4a78-a287-a4f2a67f892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:03.851670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5e0120f5-1a12-4a78-a287-a4f2a67f892c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:03.852892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5e0120f5-1a12-4a78-a287-a4f2a67f892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:03.861208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 704/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:03.910837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f0441-862e-43bb-a3ba-72c3c6383809 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:03.925657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f0441-862e-43bb-a3ba-72c3c6383809 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:03.931373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de26c9a-1194-43d6-a0e4-235bdbb1a342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:03.932012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de26c9a-1194-43d6-a0e4-235bdbb1a342 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:03.932298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de26c9a-1194-43d6-a0e4-235bdbb1a342 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:03.932577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de26c9a-1194-43d6-a0e4-235bdbb1a342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:03.941845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de26c9a-1194-43d6-a0e4-235bdbb1a342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:03.943454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de26c9a-1194-43d6-a0e4-235bdbb1a342 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:03.953921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 687/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:06.666116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b979a-062e-4551-8444-64854062c5c5 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:06.666667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b979a-062e-4551-8444-64854062c5c5 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:06.666667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b979a-062e-4551-8444-64854062c5c5 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:06.668677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 705/1392] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:06.674944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66ca27-c546-4cd5-857a-2e67aeea3752 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:06.675486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66ca27-c546-4cd5-857a-2e67aeea3752 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:06.675486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66ca27-c546-4cd5-857a-2e67aeea3752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:06.693197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-dc66ca27-c546-4cd5-857a-2e67aeea3752 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:06.694373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dc66ca27-c546-4cd5-857a-2e67aeea3752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:06.702158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 688/1393] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:06.746209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b979a-062e-4551-8444-64854062c5c5 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:06.760674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b979a-062e-4551-8444-64854062c5c5 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:06.766218 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71b50c-b92a-44da-a874-b3ed10d49b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:06.766894 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71b50c-b92a-44da-a874-b3ed10d49b57 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:06.767181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71b50c-b92a-44da-a874-b3ed10d49b57 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:06.767457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71b50c-b92a-44da-a874-b3ed10d49b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:06.775870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71b50c-b92a-44da-a874-b3ed10d49b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:06.777964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71b50c-b92a-44da-a874-b3ed10d49b57 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:06.787705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 706/1394] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:08.457765 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445dad-ad90-41cf-9896-9c6c688055ac None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:08.458330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445dad-ad90-41cf-9896-9c6c688055ac None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:08.458330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445dad-ad90-41cf-9896-9c6c688055ac None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:08.459722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 689/1395] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:08.465076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc861ee-936a-485b-aa80-5bb66df03ae2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:08.465615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc861ee-936a-485b-aa80-5bb66df03ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:08.465615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc861ee-936a-485b-aa80-5bb66df03ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:08.483742 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1fc861ee-936a-485b-aa80-5bb66df03ae2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:08.484944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1fc861ee-936a-485b-aa80-5bb66df03ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:08.492873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 707/1396] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:08.548906 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5474db-983b-4b56-b4e4-3aaa2d6c6abd None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:08.549194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5474db-983b-4b56-b4e4-3aaa2d6c6abd None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:08.549469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5474db-983b-4b56-b4e4-3aaa2d6c6abd None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:08.551057 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 690/1397] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jun 16 18:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:08.555836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32985-4047-43a6-b80e-8c40568bc8b8 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:08.556126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32985-4047-43a6-b80e-8c40568bc8b8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:08.556404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef32985-4047-43a6-b80e-8c40568bc8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:08.606158 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5ef32985-4047-43a6-b80e-8c40568bc8b8 None None] MFA Rules not processed for user `beb359ac9b084b38b77923219f42f655`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:08.607388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5ef32985-4047-43a6-b80e-8c40568bc8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:08.668603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 708/1398] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jun 16 18:43:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:08.676602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5474db-983b-4b56-b4e4-3aaa2d6c6abd None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:08.689607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5474db-983b-4b56-b4e4-3aaa2d6c6abd None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:08.693442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4f1d-591e-4fdf-99a4-4e1c13eb9013 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb359ac9b084b38b77923219f42f655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:08.694172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4f1d-591e-4fdf-99a4-4e1c13eb9013 service glance] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:08.694545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4f1d-591e-4fdf-99a4-4e1c13eb9013 service glance] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:08.694887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4f1d-591e-4fdf-99a4-4e1c13eb9013 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:08.703946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4f1d-591e-4fdf-99a4-4e1c13eb9013 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:08.705367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4f1d-591e-4fdf-99a4-4e1c13eb9013 service glance] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:08.715496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 691/1399] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:08.940723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda79e-8d0d-4f97-bff9-719f8d93f3eb None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:08.941014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda79e-8d0d-4f97-bff9-719f8d93f3eb None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:08.941321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda79e-8d0d-4f97-bff9-719f8d93f3eb None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:08.942726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 709/1400] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:08.948105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86a701-6e14-405d-ba59-653fcb299300 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:08.948395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86a701-6e14-405d-ba59-653fcb299300 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:08.948673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86a701-6e14-405d-ba59-653fcb299300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:08.966830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7b86a701-6e14-405d-ba59-653fcb299300 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:08.967959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7b86a701-6e14-405d-ba59-653fcb299300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:08.975707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 692/1401] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:09.021371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda79e-8d0d-4f97-bff9-719f8d93f3eb None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:09.036228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda79e-8d0d-4f97-bff9-719f8d93f3eb None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:09.041934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0593d-ed5d-4397-bcf3-9c3ec35bd9c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:09.043206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0593d-ed5d-4397-bcf3-9c3ec35bd9c1 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:09.043495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0593d-ed5d-4397-bcf3-9c3ec35bd9c1 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:09.043772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0593d-ed5d-4397-bcf3-9c3ec35bd9c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:09.053750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0593d-ed5d-4397-bcf3-9c3ec35bd9c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:09.056754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0593d-ed5d-4397-bcf3-9c3ec35bd9c1 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:09.075725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 710/1402] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:09.447081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773dfc7-b95f-41e6-97b4-28366c03456a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:09.447367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773dfc7-b95f-41e6-97b4-28366c03456a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:09.447643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773dfc7-b95f-41e6-97b4-28366c03456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:09.501005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2773dfc7-b95f-41e6-97b4-28366c03456a None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:09.502252 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2773dfc7-b95f-41e6-97b4-28366c03456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:09.539880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:09.573694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 693/1403] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:43:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:09.613533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f659c9-a404-4b24-b9f2-72968fa54ed2 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:09.614012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f659c9-a404-4b24-b9f2-72968fa54ed2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:09.614289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f659c9-a404-4b24-b9f2-72968fa54ed2 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:09.615789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 711/1404] 10.222.0.40 () {54 vars in 942 bytes} [Thu Jun 16 18:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:09.622833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74119aa-da9a-4ef2-b379-aa9fef4e77eb None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:09.623120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74119aa-da9a-4ef2-b379-aa9fef4e77eb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:09.623401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74119aa-da9a-4ef2-b379-aa9fef4e77eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:09.677980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f74119aa-da9a-4ef2-b379-aa9fef4e77eb None None] MFA Rules not processed for user `f7da017f9a5b4bfcb5b97b5310e0a146`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:09.679463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f74119aa-da9a-4ef2-b379-aa9fef4e77eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:09.762598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 694/1405] 10.222.0.40 () {58 vars in 1039 bytes} [Thu Jun 16 18:43:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:43:09.771875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f659c9-a404-4b24-b9f2-72968fa54ed2 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:09.779295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:09.787355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f659c9-a404-4b24-b9f2-72968fa54ed2 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:09.791766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968da42-3ac6-453b-a34b-b5f1898c140c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:09.792431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968da42-3ac6-453b-a34b-b5f1898c140c service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:09.792792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968da42-3ac6-453b-a34b-b5f1898c140c service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:09.793064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968da42-3ac6-453b-a34b-b5f1898c140c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:09.806247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968da42-3ac6-453b-a34b-b5f1898c140c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:09.807897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968da42-3ac6-453b-a34b-b5f1898c140c service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:09.817904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 712/1406] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:43:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:43:11.291717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f46f5-301f-4876-91e4-dee914cd2410 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:11.292357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f46f5-301f-4876-91e4-dee914cd2410 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:11.292357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f46f5-301f-4876-91e4-dee914cd2410 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:11.298184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 695/1407] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:43:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:11.300109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236257-edf1-450a-8b88-d291cb648453 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:11.300612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236257-edf1-450a-8b88-d291cb648453 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:11.300703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236257-edf1-450a-8b88-d291cb648453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:11.320489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-20236257-edf1-450a-8b88-d291cb648453 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:11.322054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-20236257-edf1-450a-8b88-d291cb648453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:11.330835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 713/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:11.376478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f46f5-301f-4876-91e4-dee914cd2410 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:11.392089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f46f5-301f-4876-91e4-dee914cd2410 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:11.397458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09def9-0328-4e71-a373-fb0f51f6a89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:11.398091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09def9-0328-4e71-a373-fb0f51f6a89c service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:11.398368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09def9-0328-4e71-a373-fb0f51f6a89c service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:11.398670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09def9-0328-4e71-a373-fb0f51f6a89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:11.407997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09def9-0328-4e71-a373-fb0f51f6a89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:11.409623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09def9-0328-4e71-a373-fb0f51f6a89c service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:11.419188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 696/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:21.315698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=8 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:21.414944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=62 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:43:33.521564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6031980-50e2-4715-be08-bee454a2edf7 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:33.522150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6031980-50e2-4715-be08-bee454a2edf7 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:33.522150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6031980-50e2-4715-be08-bee454a2edf7 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:33.523955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 714/1410] 10.222.0.40 () {54 vars in 918 bytes} [Thu Jun 16 18:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:33.529779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fd85-a736-4c78-bdf3-04db41ea7b1c None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:33.530337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fd85-a736-4c78-bdf3-04db41ea7b1c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:33.530337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fd85-a736-4c78-bdf3-04db41ea7b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:33.549283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-b603fd85-a736-4c78-bdf3-04db41ea7b1c None None] MFA Rules not processed for user `167e32465f314f4caf9f8df4a4710dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:33.550551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b603fd85-a736-4c78-bdf3-04db41ea7b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:33.560186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 697/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jun 16 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:33.576025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3c87a-d6d8-4beb-ae96-bd4d4d449fb7 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:33.576304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3c87a-d6d8-4beb-ae96-bd4d4d449fb7 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:33.576574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3c87a-d6d8-4beb-ae96-bd4d4d449fb7 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:33.577955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 715/1412] 10.222.0.40 () {54 vars in 918 bytes} [Thu Jun 16 18:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:43:33.583283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724db0-617e-47b1-a473-863d1f120d62 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:33.583572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724db0-617e-47b1-a473-863d1f120d62 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:33.583854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724db0-617e-47b1-a473-863d1f120d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:33.602307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-68724db0-617e-47b1-a473-863d1f120d62 None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:33.603554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-68724db0-617e-47b1-a473-863d1f120d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:33.612883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 698/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jun 16 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:36.266114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640493-3677-435a-98fc-7b69d43c2556 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:36.266736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640493-3677-435a-98fc-7b69d43c2556 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:36.266736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640493-3677-435a-98fc-7b69d43c2556 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:36.268131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:43:36.273542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6844e3-9e74-43cf-8d64-400c57868afd None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:36.274031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6844e3-9e74-43cf-8d64-400c57868afd None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:36.274151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6844e3-9e74-43cf-8d64-400c57868afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:36.293626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-3b6844e3-9e74-43cf-8d64-400c57868afd None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:36.294876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-3b6844e3-9e74-43cf-8d64-400c57868afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:36.302859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:43:36.347940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02640493-3677-435a-98fc-7b69d43c2556 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:36.364355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02640493-3677-435a-98fc-7b69d43c2556 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:36.370004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c44fe9-9173-4570-8237-ed1ec2d42fbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:36.370701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44fe9-9173-4570-8237-ed1ec2d42fbc service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:36.370990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44fe9-9173-4570-8237-ed1ec2d42fbc service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:36.371274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44fe9-9173-4570-8237-ed1ec2d42fbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:36.380825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c44fe9-9173-4570-8237-ed1ec2d42fbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:36.382423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c44fe9-9173-4570-8237-ed1ec2d42fbc service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:36.393618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 717/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:43:37.381985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7e2ac-22af-44a3-bd7e-4fb66e68ecf2 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:37.382594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7e2ac-22af-44a3-bd7e-4fb66e68ecf2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:37.382692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7e2ac-22af-44a3-bd7e-4fb66e68ecf2 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:37.384162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:37.390134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db20758-3f04-4f0e-b993-80968b9f1573 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:37.390765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db20758-3f04-4f0e-b993-80968b9f1573 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:37.390765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db20758-3f04-4f0e-b993-80968b9f1573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:37.410612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5db20758-3f04-4f0e-b993-80968b9f1573 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:37.411850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5db20758-3f04-4f0e-b993-80968b9f1573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:37.420648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:37.574964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7e2ac-22af-44a3-bd7e-4fb66e68ecf2 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:37.589919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7e2ac-22af-44a3-bd7e-4fb66e68ecf2 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:37.595333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a4639-9eb1-4ea4-a63b-d02dea9df901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:37.595967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a4639-9eb1-4ea4-a63b-d02dea9df901 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:37.596254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a4639-9eb1-4ea4-a63b-d02dea9df901 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:37.596531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a4639-9eb1-4ea4-a63b-d02dea9df901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:37.604788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a4639-9eb1-4ea4-a63b-d02dea9df901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:37.606397 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a4639-9eb1-4ea4-a63b-d02dea9df901 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:37.615873 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 701/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:38.541931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a8a4-50d5-4e16-9cf5-19012c60e46b None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:38.542679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a8a4-50d5-4e16-9cf5-19012c60e46b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:38.542679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a8a4-50d5-4e16-9cf5-19012c60e46b None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:38.543859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:38.548957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206e04a-abb4-4a21-a66c-5b3757826915 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:38.549398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206e04a-abb4-4a21-a66c-5b3757826915 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:38.549509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206e04a-abb4-4a21-a66c-5b3757826915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:38.569441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e206e04a-abb4-4a21-a66c-5b3757826915 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:38.570676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e206e04a-abb4-4a21-a66c-5b3757826915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:38.578555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:38.732506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a8a4-50d5-4e16-9cf5-19012c60e46b None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:38.747068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a8a4-50d5-4e16-9cf5-19012c60e46b None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:38.752542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4762c-9cba-42c0-aab8-c6b07d0a8360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:38.753192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4762c-9cba-42c0-aab8-c6b07d0a8360 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:38.753477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4762c-9cba-42c0-aab8-c6b07d0a8360 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:38.753759 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4762c-9cba-42c0-aab8-c6b07d0a8360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:38.762513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4762c-9cba-42c0-aab8-c6b07d0a8360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:38.764032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4762c-9cba-42c0-aab8-c6b07d0a8360 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:38.773877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 720/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:39.691140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadac35-3cc9-4899-86ac-f4a112c6c082 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:39.691703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadac35-3cc9-4899-86ac-f4a112c6c082 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:39.691703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadac35-3cc9-4899-86ac-f4a112c6c082 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:39.692983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:39.698578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0024d1-79ff-4da1-b668-08bdb08ed373 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:39.699038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0024d1-79ff-4da1-b668-08bdb08ed373 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:39.699134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0024d1-79ff-4da1-b668-08bdb08ed373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:39.717760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ff0024d1-79ff-4da1-b668-08bdb08ed373 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:39.718992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ff0024d1-79ff-4da1-b668-08bdb08ed373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:39.726708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:39.875528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadac35-3cc9-4899-86ac-f4a112c6c082 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:39.890164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadac35-3cc9-4899-86ac-f4a112c6c082 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:39.895448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e201c7f-8ecd-4333-b00b-ceab42504a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:39.896075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e201c7f-8ecd-4333-b00b-ceab42504a5a service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:39.896354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e201c7f-8ecd-4333-b00b-ceab42504a5a service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:39.896625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e201c7f-8ecd-4333-b00b-ceab42504a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:39.904820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e201c7f-8ecd-4333-b00b-ceab42504a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:39.906434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e201c7f-8ecd-4333-b00b-ceab42504a5a service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:39.916466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 704/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:40.819671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f065b-cedc-46e4-8124-cba46acb8b49 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:40.820202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f065b-cedc-46e4-8124-cba46acb8b49 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:40.820202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f065b-cedc-46e4-8124-cba46acb8b49 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:40.821549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:40.826593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e331c-4b88-4917-a3ec-e0ded3d0f15d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:40.826991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e331c-4b88-4917-a3ec-e0ded3d0f15d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:40.827158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e331c-4b88-4917-a3ec-e0ded3d0f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:40.844968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c80e331c-4b88-4917-a3ec-e0ded3d0f15d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:40.846161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c80e331c-4b88-4917-a3ec-e0ded3d0f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:40.854688 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:41.010447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f065b-cedc-46e4-8124-cba46acb8b49 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:41.024966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f065b-cedc-46e4-8124-cba46acb8b49 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:41.030685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8a67e-c01f-449a-b0d4-8dd671a82f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:41.031340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8a67e-c01f-449a-b0d4-8dd671a82f58 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:41.031621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8a67e-c01f-449a-b0d4-8dd671a82f58 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:41.031893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8a67e-c01f-449a-b0d4-8dd671a82f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:41.040756 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8a67e-c01f-449a-b0d4-8dd671a82f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:41.042335 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8a67e-c01f-449a-b0d4-8dd671a82f58 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:41.051878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 723/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:41.927621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caf813-44cd-4d5d-8eaa-dc7f7c6a542b None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:41.928196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caf813-44cd-4d5d-8eaa-dc7f7c6a542b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:41.928196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caf813-44cd-4d5d-8eaa-dc7f7c6a542b None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:41.929595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:41.934823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067ed3-b795-4f82-a99f-86f99231e951 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:41.935262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067ed3-b795-4f82-a99f-86f99231e951 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:41.935428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067ed3-b795-4f82-a99f-86f99231e951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:41.953220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-83067ed3-b795-4f82-a99f-86f99231e951 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:41.954442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-83067ed3-b795-4f82-a99f-86f99231e951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:41.962252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:42.115288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caf813-44cd-4d5d-8eaa-dc7f7c6a542b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:42.130143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caf813-44cd-4d5d-8eaa-dc7f7c6a542b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:42.135503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74584eaf-e8c6-45d4-9510-07660da2586a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:42.136127 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74584eaf-e8c6-45d4-9510-07660da2586a service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:42.136414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74584eaf-e8c6-45d4-9510-07660da2586a service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:42.136684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74584eaf-e8c6-45d4-9510-07660da2586a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:42.145233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74584eaf-e8c6-45d4-9510-07660da2586a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:42.146892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74584eaf-e8c6-45d4-9510-07660da2586a service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:42.156701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 707/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:43.014071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf9aa1-a05a-4237-af84-c74922e1886b None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:43.014675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf9aa1-a05a-4237-af84-c74922e1886b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:43.014675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf9aa1-a05a-4237-af84-c74922e1886b None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:43.016027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:43.022036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37c61-85fa-447a-a193-26fbde987b90 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:43.022567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37c61-85fa-447a-a193-26fbde987b90 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:43.022672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e37c61-85fa-447a-a193-26fbde987b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:43.041280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f4e37c61-85fa-447a-a193-26fbde987b90 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:43.042520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f4e37c61-85fa-447a-a193-26fbde987b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:43.050401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:43.203226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf9aa1-a05a-4237-af84-c74922e1886b None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:43.218004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf9aa1-a05a-4237-af84-c74922e1886b None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:43.223763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4edbe-5b9d-499a-b6fc-2e4e14221551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:43.224403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4edbe-5b9d-499a-b6fc-2e4e14221551 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:43.224690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4edbe-5b9d-499a-b6fc-2e4e14221551 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:43.224968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4edbe-5b9d-499a-b6fc-2e4e14221551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:43.233235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4edbe-5b9d-499a-b6fc-2e4e14221551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:43.234856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4edbe-5b9d-499a-b6fc-2e4e14221551 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:43.244825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 726/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:44.187521 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f95677-5945-4982-9bea-cde1410636bd None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:44.188062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f95677-5945-4982-9bea-cde1410636bd None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:44.188062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f95677-5945-4982-9bea-cde1410636bd None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:44.189370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:44.194247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a82f-c288-462e-88a2-ef0f8a443a46 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:44.194721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a82f-c288-462e-88a2-ef0f8a443a46 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:44.194831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489a82f-c288-462e-88a2-ef0f8a443a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:44.213114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-6489a82f-c288-462e-88a2-ef0f8a443a46 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:44.214347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6489a82f-c288-462e-88a2-ef0f8a443a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:44.222092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:44.372772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f95677-5945-4982-9bea-cde1410636bd None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:44.387398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f95677-5945-4982-9bea-cde1410636bd None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:44.392636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c7e06-2824-425f-b52c-174bfdbb9efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:44.393268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c7e06-2824-425f-b52c-174bfdbb9efb service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:44.393550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c7e06-2824-425f-b52c-174bfdbb9efb service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:44.393820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c7e06-2824-425f-b52c-174bfdbb9efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:44.402142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c7e06-2824-425f-b52c-174bfdbb9efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:44.403795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c7e06-2824-425f-b52c-174bfdbb9efb service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:44.413389 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 710/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:45.260331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73363b3-7d80-4b82-890f-606076cfa13d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:45.260935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73363b3-7d80-4b82-890f-606076cfa13d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:45.260935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73363b3-7d80-4b82-890f-606076cfa13d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:45.262296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:45.267944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436a3cc-dcdd-4161-8369-d642a5a98417 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:45.268519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436a3cc-dcdd-4161-8369-d642a5a98417 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:45.268519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436a3cc-dcdd-4161-8369-d642a5a98417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:45.288280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e436a3cc-dcdd-4161-8369-d642a5a98417 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:45.289519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e436a3cc-dcdd-4161-8369-d642a5a98417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:45.298271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:45.451693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73363b3-7d80-4b82-890f-606076cfa13d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:45.467641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73363b3-7d80-4b82-890f-606076cfa13d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:45.473139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a419e3-fad6-4ee4-9637-28da52d550e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:45.473787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a419e3-fad6-4ee4-9637-28da52d550e3 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:45.474074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a419e3-fad6-4ee4-9637-28da52d550e3 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:45.474354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a419e3-fad6-4ee4-9637-28da52d550e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:45.483669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a419e3-fad6-4ee4-9637-28da52d550e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:45.485252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a419e3-fad6-4ee4-9637-28da52d550e3 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:45.495284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 729/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:47.542217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f142-7f2b-42b1-8e41-bc96184661cc None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:47.542818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f142-7f2b-42b1-8e41-bc96184661cc None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:47.542818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f142-7f2b-42b1-8e41-bc96184661cc None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:47.544155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:47.549334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54acb77-1d27-41f9-bd8d-5b4840116811 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:47.549765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54acb77-1d27-41f9-bd8d-5b4840116811 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:47.549877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54acb77-1d27-41f9-bd8d-5b4840116811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:47.569593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b54acb77-1d27-41f9-bd8d-5b4840116811 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:47.570823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b54acb77-1d27-41f9-bd8d-5b4840116811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:47.579034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:47.617424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f142-7f2b-42b1-8e41-bc96184661cc None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:47.627988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f142-7f2b-42b1-8e41-bc96184661cc None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:47.631450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1666f1d-5303-415a-9154-a99685700f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:47.632077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1666f1d-5303-415a-9154-a99685700f13 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:47.632355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1666f1d-5303-415a-9154-a99685700f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:47.632630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1666f1d-5303-415a-9154-a99685700f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:47.642135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1666f1d-5303-415a-9154-a99685700f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:47.643633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1666f1d-5303-415a-9154-a99685700f13 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:47.653408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 713/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:50.043114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5cd9e-f0cb-4104-aa9f-982ab13f9a30 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:50.043690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5cd9e-f0cb-4104-aa9f-982ab13f9a30 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:50.043690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5cd9e-f0cb-4104-aa9f-982ab13f9a30 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:50.045058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:50.050566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611fc4-f5f7-46ee-825d-46452a02bd69 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:50.051057 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611fc4-f5f7-46ee-825d-46452a02bd69 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:50.051182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611fc4-f5f7-46ee-825d-46452a02bd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:50.070543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c2611fc4-f5f7-46ee-825d-46452a02bd69 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:50.072370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c2611fc4-f5f7-46ee-825d-46452a02bd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:50.080592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:50.119600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5cd9e-f0cb-4104-aa9f-982ab13f9a30 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:50.130755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5cd9e-f0cb-4104-aa9f-982ab13f9a30 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:50.135202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b6f9b-602b-417d-8fbe-8dfdfc19164f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:50.135845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b6f9b-602b-417d-8fbe-8dfdfc19164f service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:50.136124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b6f9b-602b-417d-8fbe-8dfdfc19164f service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:50.136402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b6f9b-602b-417d-8fbe-8dfdfc19164f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:50.145726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b6f9b-602b-417d-8fbe-8dfdfc19164f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:50.147179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b6f9b-602b-417d-8fbe-8dfdfc19164f service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:50.156755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 732/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:43:52.613039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979e50c-112d-478e-b459-167609efcf03 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:52.613599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979e50c-112d-478e-b459-167609efcf03 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:52.613599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979e50c-112d-478e-b459-167609efcf03 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:52.614999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:52.620948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f2592-ec00-42c8-a943-53a39739fc9e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:52.621361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f2592-ec00-42c8-a943-53a39739fc9e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:52.621498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f2592-ec00-42c8-a943-53a39739fc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:52.641083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-033f2592-ec00-42c8-a943-53a39739fc9e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:52.642275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-033f2592-ec00-42c8-a943-53a39739fc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:52.649938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:52.688453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979e50c-112d-478e-b459-167609efcf03 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:52.699320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979e50c-112d-478e-b459-167609efcf03 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:52.702820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccea6f-8578-44e1-8fb4-b2ecc138a9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:52.703456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccea6f-8578-44e1-8fb4-b2ecc138a9fd service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:52.703740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccea6f-8578-44e1-8fb4-b2ecc138a9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:52.704041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccea6f-8578-44e1-8fb4-b2ecc138a9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:52.713134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccea6f-8578-44e1-8fb4-b2ecc138a9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:52.714599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccea6f-8578-44e1-8fb4-b2ecc138a9fd service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:52.724323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 716/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:55.000413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a1a32-4364-4e9d-a1cb-002d94fc095f None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:55.000993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a1a32-4364-4e9d-a1cb-002d94fc095f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:55.000993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a1a32-4364-4e9d-a1cb-002d94fc095f None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:55.002400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:55.007878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dec0a-f395-490b-bf73-ee781ebf7570 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:55.008295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dec0a-f395-490b-bf73-ee781ebf7570 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:55.008469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dec0a-f395-490b-bf73-ee781ebf7570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:55.027064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a43dec0a-f395-490b-bf73-ee781ebf7570 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:55.028305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a43dec0a-f395-490b-bf73-ee781ebf7570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:55.036904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:55.076817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a1a32-4364-4e9d-a1cb-002d94fc095f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:55.087592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a1a32-4364-4e9d-a1cb-002d94fc095f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:55.091123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf0ed5-4e67-4012-a9f5-fc9c0f1aed7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:55.091758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf0ed5-4e67-4012-a9f5-fc9c0f1aed7f service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:55.092043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf0ed5-4e67-4012-a9f5-fc9c0f1aed7f service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:55.092319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf0ed5-4e67-4012-a9f5-fc9c0f1aed7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:55.101367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf0ed5-4e67-4012-a9f5-fc9c0f1aed7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:55.103361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf0ed5-4e67-4012-a9f5-fc9c0f1aed7f service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:55.113247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 735/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:57.387228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426b4d9-2d5c-4449-b430-8b7db95630a3 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:57.387825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426b4d9-2d5c-4449-b430-8b7db95630a3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:57.387825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426b4d9-2d5c-4449-b430-8b7db95630a3 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:57.389158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:57.394593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3896-d149-471e-867e-b6718775cabe None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:57.395070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3896-d149-471e-867e-b6718775cabe None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:57.395182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3896-d149-471e-867e-b6718775cabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:57.413593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-41fa3896-d149-471e-867e-b6718775cabe None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:57.415365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-41fa3896-d149-471e-867e-b6718775cabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:57.424054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:43:57.463832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426b4d9-2d5c-4449-b430-8b7db95630a3 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:57.474738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426b4d9-2d5c-4449-b430-8b7db95630a3 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:57.478902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f523-de63-4af1-969d-20d3937cd821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:57.479549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f523-de63-4af1-969d-20d3937cd821 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:57.479833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f523-de63-4af1-969d-20d3937cd821 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:57.480108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f523-de63-4af1-969d-20d3937cd821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:57.489613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0f523-de63-4af1-969d-20d3937cd821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:57.491097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0f523-de63-4af1-969d-20d3937cd821 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:57.510415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 719/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:43:59.725366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2302e6a-0239-4412-a383-472af262a0b6 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:59.725947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2302e6a-0239-4412-a383-472af262a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:59.725947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2302e6a-0239-4412-a383-472af262a0b6 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:59.727926 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:43:59.733793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1fbf6-c99f-4fd6-8f3e-d546dede9ea4 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:59.734407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1fbf6-c99f-4fd6-8f3e-d546dede9ea4 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:59.734407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1fbf6-c99f-4fd6-8f3e-d546dede9ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:59.752916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-71d1fbf6-c99f-4fd6-8f3e-d546dede9ea4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:43:59.754124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-71d1fbf6-c99f-4fd6-8f3e-d546dede9ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:43:59.765666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:43:59.803877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2302e6a-0239-4412-a383-472af262a0b6 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:43:59.814821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2302e6a-0239-4412-a383-472af262a0b6 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:43:59.818303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cd69a-ea01-4c59-90bd-640aff83a2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:43:59.818962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cd69a-ea01-4c59-90bd-640aff83a2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:43:59.819243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cd69a-ea01-4c59-90bd-640aff83a2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:43:59.819516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cd69a-ea01-4c59-90bd-640aff83a2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:43:59.828744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cd69a-ea01-4c59-90bd-640aff83a2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:43:59.830190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2cd69a-ea01-4c59-90bd-640aff83a2d7 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:43:59.840665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 738/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:02.317843 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174f96f-21fb-41c6-9197-79caeaab7853 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:02.318645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174f96f-21fb-41c6-9197-79caeaab7853 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:02.318645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174f96f-21fb-41c6-9197-79caeaab7853 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:02.319801 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:02.326762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dbad8-ce41-4a4b-8562-51bcdec1f62a None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:02.327281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dbad8-ce41-4a4b-8562-51bcdec1f62a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:02.327378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dbad8-ce41-4a4b-8562-51bcdec1f62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:02.333363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=70 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:02.346703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4c8dbad8-ce41-4a4b-8562-51bcdec1f62a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:02.347905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4c8dbad8-ce41-4a4b-8562-51bcdec1f62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:02.356175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:02.393577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174f96f-21fb-41c6-9197-79caeaab7853 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:02.399120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=73 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:02.405611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174f96f-21fb-41c6-9197-79caeaab7853 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:02.409231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb8d13-011e-4a5c-a2a2-287e8f1b47e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:02.409877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8d13-011e-4a5c-a2a2-287e8f1b47e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:02.410161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8d13-011e-4a5c-a2a2-287e8f1b47e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:02.410471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8d13-011e-4a5c-a2a2-287e8f1b47e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:02.420707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb8d13-011e-4a5c-a2a2-287e8f1b47e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:02.422154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb8d13-011e-4a5c-a2a2-287e8f1b47e9 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:02.433575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 722/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:04.630752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828e2d-0c07-4c3f-b53f-56ab2ed51448 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:04.631298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828e2d-0c07-4c3f-b53f-56ab2ed51448 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:04.631298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828e2d-0c07-4c3f-b53f-56ab2ed51448 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:04.632683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:04.637881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb20db-c332-4dfc-89f3-00c706e226eb None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:04.638301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb20db-c332-4dfc-89f3-00c706e226eb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:04.638484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb20db-c332-4dfc-89f3-00c706e226eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:04.656219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-0beb20db-c332-4dfc-89f3-00c706e226eb None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:04.657409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0beb20db-c332-4dfc-89f3-00c706e226eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:04.665768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:04.703826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7828e2d-0c07-4c3f-b53f-56ab2ed51448 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:04.714662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7828e2d-0c07-4c3f-b53f-56ab2ed51448 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:04.718189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fc7f7-39bd-45fe-aa76-6651ce76b9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:04.718869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc7f7-39bd-45fe-aa76-6651ce76b9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:04.719154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc7f7-39bd-45fe-aa76-6651ce76b9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:04.719438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc7f7-39bd-45fe-aa76-6651ce76b9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:04.729246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fc7f7-39bd-45fe-aa76-6651ce76b9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:04.730710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fc7f7-39bd-45fe-aa76-6651ce76b9f2 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:04.740318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 741/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:06.902797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39bbe7-cb57-4df9-9b2c-b836461c0706 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:06.903428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39bbe7-cb57-4df9-9b2c-b836461c0706 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:06.903428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39bbe7-cb57-4df9-9b2c-b836461c0706 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:06.904693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:06.910124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408bb3-987d-41d2-9fdb-b76d1dd20c8b None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:06.910836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408bb3-987d-41d2-9fdb-b76d1dd20c8b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:06.911166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b408bb3-987d-41d2-9fdb-b76d1dd20c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:06.928799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-0b408bb3-987d-41d2-9fdb-b76d1dd20c8b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:06.930027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0b408bb3-987d-41d2-9fdb-b76d1dd20c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:06.937989 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:06.974323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39bbe7-cb57-4df9-9b2c-b836461c0706 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:06.984886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39bbe7-cb57-4df9-9b2c-b836461c0706 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:06.988333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86324ca0-eb63-4f2a-bff5-5640772a2d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:06.988957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86324ca0-eb63-4f2a-bff5-5640772a2d66 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:06.989233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86324ca0-eb63-4f2a-bff5-5640772a2d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:06.989505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86324ca0-eb63-4f2a-bff5-5640772a2d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:06.998312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86324ca0-eb63-4f2a-bff5-5640772a2d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:06.999766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86324ca0-eb63-4f2a-bff5-5640772a2d66 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:07.009624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 725/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:09.344460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d32f2-40ab-4ba4-8b1f-1e5008f33953 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:09.345033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d32f2-40ab-4ba4-8b1f-1e5008f33953 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:09.345033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d32f2-40ab-4ba4-8b1f-1e5008f33953 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:09.346483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:44:09.352598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f0874-6621-403b-acf3-1e82dea3e50d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:09.353288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f0874-6621-403b-acf3-1e82dea3e50d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:09.353288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f0874-6621-403b-acf3-1e82dea3e50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:09.375324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-229f0874-6621-403b-acf3-1e82dea3e50d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:09.376476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-229f0874-6621-403b-acf3-1e82dea3e50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:09.385267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:09.422050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d32f2-40ab-4ba4-8b1f-1e5008f33953 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:09.435910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d32f2-40ab-4ba4-8b1f-1e5008f33953 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:09.439487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116ebc5-1792-4759-97ea-4ac29392ec0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:09.440128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ebc5-1792-4759-97ea-4ac29392ec0b service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:09.440408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ebc5-1792-4759-97ea-4ac29392ec0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:09.440680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ebc5-1792-4759-97ea-4ac29392ec0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:09.450639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116ebc5-1792-4759-97ea-4ac29392ec0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:09.452068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116ebc5-1792-4759-97ea-4ac29392ec0b service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:09.462551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 744/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:19.368527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=17 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:19.457485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=17 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:29.594950 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5478f1-d12c-4725-bbea-36ce98314658 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:29.595486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5478f1-d12c-4725-bbea-36ce98314658 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:29.595486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5478f1-d12c-4725-bbea-36ce98314658 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:29.596867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 727/1471] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:29.602119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe45e5-c227-4145-a32f-f321c299777c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:29.602554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe45e5-c227-4145-a32f-f321c299777c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:29.602728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe45e5-c227-4145-a32f-f321c299777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:29.620116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-09fe45e5-c227-4145-a32f-f321c299777c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:29.621341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-09fe45e5-c227-4145-a32f-f321c299777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:29.629130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 745/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:29.675915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0c5a2-3234-4b21-bd1d-8ff62e9f55c8 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:29.676206 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0c5a2-3234-4b21-bd1d-8ff62e9f55c8 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:29.676529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0c5a2-3234-4b21-bd1d-8ff62e9f55c8 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:29.677883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 728/1473] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jun 16 18:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:29.682870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca17c8b-5be1-4fae-a9da-fd965869f2ea None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:29.683161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca17c8b-5be1-4fae-a9da-fd965869f2ea None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:29.683444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca17c8b-5be1-4fae-a9da-fd965869f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:29.701735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-dca17c8b-5be1-4fae-a9da-fd965869f2ea None None] MFA Rules not processed for user `beb359ac9b084b38b77923219f42f655`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:29.702971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dca17c8b-5be1-4fae-a9da-fd965869f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:29.709438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 746/1474] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jun 16 18:44:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:29.717220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0c5a2-3234-4b21-bd1d-8ff62e9f55c8 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:29.727716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0c5a2-3234-4b21-bd1d-8ff62e9f55c8 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:29.731235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1d23c-e39a-45f0-a052-5950bf5e5b6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb359ac9b084b38b77923219f42f655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:29.731870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1d23c-e39a-45f0-a052-5950bf5e5b6e service glance] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:29.732151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1d23c-e39a-45f0-a052-5950bf5e5b6e service glance] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:29.732425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1d23c-e39a-45f0-a052-5950bf5e5b6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:29.742343 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1d23c-e39a-45f0-a052-5950bf5e5b6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:29.743839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1d23c-e39a-45f0-a052-5950bf5e5b6e service glance] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:29.754522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 729/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:31.986978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f1454-79fd-41fd-a3dc-fe1ed0add047 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:31.987582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f1454-79fd-41fd-a3dc-fe1ed0add047 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:31.987582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f1454-79fd-41fd-a3dc-fe1ed0add047 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:31.988939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 747/1476] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:31.994139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5c915-e01e-484d-b16c-c1014594fad3 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:31.994588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5c915-e01e-484d-b16c-c1014594fad3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:31.994729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5c915-e01e-484d-b16c-c1014594fad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:32.012100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-23b5c915-e01e-484d-b16c-c1014594fad3 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:32.013287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-23b5c915-e01e-484d-b16c-c1014594fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:32.021089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 730/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:32.045183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f1454-79fd-41fd-a3dc-fe1ed0add047 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:32.057993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f1454-79fd-41fd-a3dc-fe1ed0add047 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:32.062498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00991e44-dea3-4beb-be5b-d86f0a9be761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:32.063142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00991e44-dea3-4beb-be5b-d86f0a9be761 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:32.063447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00991e44-dea3-4beb-be5b-d86f0a9be761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:32.063720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00991e44-dea3-4beb-be5b-d86f0a9be761 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:32.064439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00991e44-dea3-4beb-be5b-d86f0a9be761 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:32.066199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING py.warnings [None req-00991e44-dea3-4beb-be5b-d86f0a9be761 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:44:32.066199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: warnings.warn(msg) Jun 16 18:44:32.066199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: Jun 16 18:44:32.067385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00991e44-dea3-4beb-be5b-d86f0a9be761 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:32.086675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 748/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jun 16 18:44:32 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:44:34.246610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cb366-7f83-4075-8a35-7586f16012f3 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:34.247188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cb366-7f83-4075-8a35-7586f16012f3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:34.247188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cb366-7f83-4075-8a35-7586f16012f3 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:34.248518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 731/1479] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:34.254005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd35e4-70a3-48e1-8f31-db43e20f4902 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:34.254491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd35e4-70a3-48e1-8f31-db43e20f4902 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:34.254606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd35e4-70a3-48e1-8f31-db43e20f4902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:34.275717 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-c2cd35e4-70a3-48e1-8f31-db43e20f4902 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:34.276935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c2cd35e4-70a3-48e1-8f31-db43e20f4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:34.284912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 749/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:34.329076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cb366-7f83-4075-8a35-7586f16012f3 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:34.344555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cb366-7f83-4075-8a35-7586f16012f3 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:34.351002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc2ce-9b32-4056-9d59-7e0366480ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:34.351671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc2ce-9b32-4056-9d59-7e0366480ef5 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:34.351961 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc2ce-9b32-4056-9d59-7e0366480ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:34.352263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc2ce-9b32-4056-9d59-7e0366480ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:34.361633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc2ce-9b32-4056-9d59-7e0366480ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:34.363288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bc2ce-9b32-4056-9d59-7e0366480ef5 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:34.374090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 732/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:36.695665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40351e9e-55c7-489b-8dcc-1c7ffa4fb99d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:36.696235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40351e9e-55c7-489b-8dcc-1c7ffa4fb99d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:36.696235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40351e9e-55c7-489b-8dcc-1c7ffa4fb99d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:36.697609 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 750/1482] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:36.703100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d007763-77d2-445a-88ed-6f3250aa6177 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:36.703531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d007763-77d2-445a-88ed-6f3250aa6177 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:36.703665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d007763-77d2-445a-88ed-6f3250aa6177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:36.722299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-9d007763-77d2-445a-88ed-6f3250aa6177 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:36.723560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-9d007763-77d2-445a-88ed-6f3250aa6177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:36.731713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 733/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:36.768929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40351e9e-55c7-489b-8dcc-1c7ffa4fb99d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:36.779576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40351e9e-55c7-489b-8dcc-1c7ffa4fb99d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:36.783072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecfeb-2cad-403b-8b21-5f3f96d09dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:36.783707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecfeb-2cad-403b-8b21-5f3f96d09dba service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:36.783991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecfeb-2cad-403b-8b21-5f3f96d09dba service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:36.784267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecfeb-2cad-403b-8b21-5f3f96d09dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:36.793324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecfeb-2cad-403b-8b21-5f3f96d09dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:36.794787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecfeb-2cad-403b-8b21-5f3f96d09dba service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:36.804853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 751/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:38.983912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44eef4-3f6c-454c-adb1-9ac292e2475b None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:38.984482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44eef4-3f6c-454c-adb1-9ac292e2475b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:38.984482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44eef4-3f6c-454c-adb1-9ac292e2475b None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:38.985813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 734/1485] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:38.991219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769e47-2f79-4d6a-94a4-0375958df68d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:38.991653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769e47-2f79-4d6a-94a4-0375958df68d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:38.991777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769e47-2f79-4d6a-94a4-0375958df68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:39.010373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-c1769e47-2f79-4d6a-94a4-0375958df68d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:39.011593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c1769e47-2f79-4d6a-94a4-0375958df68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:39.019414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 752/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:39.057720 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44eef4-3f6c-454c-adb1-9ac292e2475b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:39.068353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44eef4-3f6c-454c-adb1-9ac292e2475b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:39.072427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34b400-f472-4958-b5ae-5adc828e246e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:39.073051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34b400-f472-4958-b5ae-5adc828e246e service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:39.073331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34b400-f472-4958-b5ae-5adc828e246e service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:39.073603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34b400-f472-4958-b5ae-5adc828e246e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:39.082280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34b400-f472-4958-b5ae-5adc828e246e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:39.083725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34b400-f472-4958-b5ae-5adc828e246e service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:39.093729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 735/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:41.402605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc6fb0-59fe-428a-a5d4-cfc67bec9112 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:41.403174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc6fb0-59fe-428a-a5d4-cfc67bec9112 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:41.403174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc6fb0-59fe-428a-a5d4-cfc67bec9112 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:41.404516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 753/1488] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:44:41.409694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659b9c-acf3-4b50-95ce-387bb9e158f8 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:41.410155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659b9c-acf3-4b50-95ce-387bb9e158f8 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:41.410274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659b9c-acf3-4b50-95ce-387bb9e158f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:41.427690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e4659b9c-acf3-4b50-95ce-387bb9e158f8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:41.428878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e4659b9c-acf3-4b50-95ce-387bb9e158f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:41.436952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 736/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:44:41.476586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc6fb0-59fe-428a-a5d4-cfc67bec9112 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:41.487133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc6fb0-59fe-428a-a5d4-cfc67bec9112 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:41.490588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8e9a-2a55-4d44-a3b4-cf69206bd110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:41.491219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8e9a-2a55-4d44-a3b4-cf69206bd110 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:41.491499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8e9a-2a55-4d44-a3b4-cf69206bd110 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:41.491773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8e9a-2a55-4d44-a3b4-cf69206bd110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:41.500756 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad8e9a-2a55-4d44-a3b4-cf69206bd110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:41.502222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad8e9a-2a55-4d44-a3b4-cf69206bd110 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:41.512637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 754/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:43.894846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46817d0-a9c0-4c01-91d3-e1a59d3d9a72 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:43.895775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46817d0-a9c0-4c01-91d3-e1a59d3d9a72 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:43.895775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46817d0-a9c0-4c01-91d3-e1a59d3d9a72 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:43.897301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 737/1491] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jun 16 18:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 18:44:43.903050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bff07-cfb3-499c-9a05-1cb2fa80fa28 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:43.903901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bff07-cfb3-499c-9a05-1cb2fa80fa28 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:43.903901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bff07-cfb3-499c-9a05-1cb2fa80fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:43.923287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4d0bff07-cfb3-499c-9a05-1cb2fa80fa28 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:44:43.924721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4d0bff07-cfb3-499c-9a05-1cb2fa80fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:43.933676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 755/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jun 16 18:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:44:43.979585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46817d0-a9c0-4c01-91d3-e1a59d3d9a72 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:44:43.981608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b46817d0-a9c0-4c01-91d3-e1a59d3d9a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:44:43.996470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46817d0-a9c0-4c01-91d3-e1a59d3d9a72 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:44:44.000446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcae2a7-ce82-49a4-af70-f3a1383a309f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:44:44.001231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcae2a7-ce82-49a4-af70-f3a1383a309f service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:44:44.001607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcae2a7-ce82-49a4-af70-f3a1383a309f service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:44:44.001974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcae2a7-ce82-49a4-af70-f3a1383a309f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:44:44.012543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcae2a7-ce82-49a4-af70-f3a1383a309f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:44:44.014196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcae2a7-ce82-49a4-af70-f3a1383a309f service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:44:44.025075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 738/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:44:53.917600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=33 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:54.020008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=33 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:22.319603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b60ce6-3572-4eec-b46e-ec5a99030dde None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.320516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b60ce6-3572-4eec-b46e-ec5a99030dde None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.320516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b60ce6-3572-4eec-b46e-ec5a99030dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.341350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-82b60ce6-3572-4eec-b46e-ec5a99030dde None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:46:22.342613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-82b60ce6-3572-4eec-b46e-ec5a99030dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:46:22.350915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 756/1494] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:46:22.360745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eb1c5-521a-4717-9179-0b154c0615b7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.361418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eb1c5-521a-4717-9179-0b154c0615b7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.361418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eb1c5-521a-4717-9179-0b154c0615b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.382153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-6a6eb1c5-521a-4717-9179-0b154c0615b7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:46:22.383475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6a6eb1c5-521a-4717-9179-0b154c0615b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:46:22.392189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 739/1495] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:46:22.399849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b60ce6-3572-4eec-b46e-ec5a99030dde None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:22.416722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b60ce6-3572-4eec-b46e-ec5a99030dde None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:22.423970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:22.425611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.426128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.426644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.428253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:46:22.428811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:22.430737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING py.warnings [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:46:22.430737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: warnings.warn(msg) Jun 16 18:46:22.430737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: Jun 16 18:46:22.432146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:22.454821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 757/1496] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:46:22.462956 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eb1c5-521a-4717-9179-0b154c0615b7 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:22.472925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eb1c5-521a-4717-9179-0b154c0615b7 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:22.477927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35126e-9dc6-4b63-bff4-f5187b648b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:22.478642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35126e-9dc6-4b63-bff4-f5187b648b33 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.478923 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35126e-9dc6-4b63-bff4-f5187b648b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.479190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35126e-9dc6-4b63-bff4-f5187b648b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.479898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35126e-9dc6-4b63-bff4-f5187b648b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:22.481752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WARNING py.warnings [None req-3c35126e-9dc6-4b63-bff4-f5187b648b33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:46:22.481752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: warnings.warn(msg) Jun 16 18:46:22.481752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: Jun 16 18:46:22.483001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35126e-9dc6-4b63-bff4-f5187b648b33 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:22.537343 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 740/1497] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:46:22 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:46:22.541964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:22.553937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bf098-c5ce-41c8-8525-8123f16b9414 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:22.621821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e281-f91e-48f7-9587-25266225e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:22.622450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e281-f91e-48f7-9587-25266225e7be admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.622735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e281-f91e-48f7-9587-25266225e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.623014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e281-f91e-48f7-9587-25266225e7be admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.623723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56e281-f91e-48f7-9587-25266225e7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:22.624743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING py.warnings [None req-dd56e281-f91e-48f7-9587-25266225e7be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:46:22.624743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: warnings.warn(msg) Jun 16 18:46:22.624743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: Jun 16 18:46:22.625956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56e281-f91e-48f7-9587-25266225e7be admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:22.647274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 758/1498] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:46:22 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:46:22.651828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35126e-9dc6-4b63-bff4-f5187b648b33 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:22.663398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35126e-9dc6-4b63-bff4-f5187b648b33 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:22.668181 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625648-dcfe-4d5e-9d8c-3c1540b971ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:22.668862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625648-dcfe-4d5e-9d8c-3c1540b971ad admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.669149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625648-dcfe-4d5e-9d8c-3c1540b971ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.669433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625648-dcfe-4d5e-9d8c-3c1540b971ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.670167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17625648-dcfe-4d5e-9d8c-3c1540b971ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:22.671238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WARNING py.warnings [None req-17625648-dcfe-4d5e-9d8c-3c1540b971ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:46:22.671238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: warnings.warn(msg) Jun 16 18:46:22.671238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: Jun 16 18:46:22.672136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17625648-dcfe-4d5e-9d8c-3c1540b971ad admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:22.687267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 741/1499] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:46:22.691673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e281-f91e-48f7-9587-25266225e7be admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:22.702129 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e281-f91e-48f7-9587-25266225e7be admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:22.707040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256454e-daec-44be-bb48-d6140c3fffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:22.707723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256454e-daec-44be-bb48-d6140c3fffc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.708009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256454e-daec-44be-bb48-d6140c3fffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.708293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256454e-daec-44be-bb48-d6140c3fffc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.709033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256454e-daec-44be-bb48-d6140c3fffc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:22.710051 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING py.warnings [None req-5256454e-daec-44be-bb48-d6140c3fffc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:46:22.710051 dv-cinder-846171-1-smb devstack@keystone.service[86897]: warnings.warn(msg) Jun 16 18:46:22.710051 dv-cinder-846171-1-smb devstack@keystone.service[86897]: Jun 16 18:46:22.710990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256454e-daec-44be-bb48-d6140c3fffc3 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:22.726884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 759/1500] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:46:22.731469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625648-dcfe-4d5e-9d8c-3c1540b971ad admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:22.743683 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625648-dcfe-4d5e-9d8c-3c1540b971ad admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:22.748687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ede3f-6bc5-43fd-bafa-5d2ef413c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:22.749591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ede3f-6bc5-43fd-bafa-5d2ef413c58a admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.749873 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ede3f-6bc5-43fd-bafa-5d2ef413c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.750150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ede3f-6bc5-43fd-bafa-5d2ef413c58a admin admin] PATH_INFO: `/v3/projects/76ddd51d6ecf48fca8737443cba72cd6/users/47ed02f482864d709c8d06bc7f00aba7/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.766545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ede3f-6bc5-43fd-bafa-5d2ef413c58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ddd51d6ecf48fca8737443cba72cd6, user_id=47ed02f482864d709c8d06bc7f00aba7, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:22.767605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WARNING py.warnings [None req-ee2ede3f-6bc5-43fd-bafa-5d2ef413c58a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:46:22.767605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: warnings.warn(msg) Jun 16 18:46:22.767605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: Jun 16 18:46:22.773410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ede3f-6bc5-43fd-bafa-5d2ef413c58a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:22.789593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 742/1501] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:46:22 2022] PUT /identity/v3/projects/76ddd51d6ecf48fca8737443cba72cd6/users/47ed02f482864d709c8d06bc7f00aba7/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:46:22.802802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04382-7b46-4f32-8f34-a2a7757842fe None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.803406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04382-7b46-4f32-8f34-a2a7757842fe None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.803733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04382-7b46-4f32-8f34-a2a7757842fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.833135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5eb04382-7b46-4f32-8f34-a2a7757842fe None None] MFA Rules not processed for user `47ed02f482864d709c8d06bc7f00aba7`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:46:22.834529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5eb04382-7b46-4f32-8f34-a2a7757842fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:46:22.907044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 760/1502] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:46:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:46:22.926205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ab45d-1931-4655-9cc1-ba249431347d None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.926793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ab45d-1931-4655-9cc1-ba249431347d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.927227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ab45d-1931-4655-9cc1-ba249431347d None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.929246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 743/1503] 10.222.0.40 () {54 vars in 963 bytes} [Thu Jun 16 18:46:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:46:22.935288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c4d41-e8fa-4249-87dd-2e71db2ffb20 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:22.935744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c4d41-e8fa-4249-87dd-2e71db2ffb20 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:22.936120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c4d41-e8fa-4249-87dd-2e71db2ffb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:22.968964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-677c4d41-e8fa-4249-87dd-2e71db2ffb20 None None] MFA Rules not processed for user `387fd99ff326463698bc32947ba25d77`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:46:22.972115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-677c4d41-e8fa-4249-87dd-2e71db2ffb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:46:23.027772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:23.039066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 761/1504] 10.222.0.40 () {58 vars in 1060 bytes} [Thu Jun 16 18:46:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:46:23.047307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ab45d-1931-4655-9cc1-ba249431347d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:23.059568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ab45d-1931-4655-9cc1-ba249431347d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:23.063369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19acec1-21e3-471d-9252-274e7ffe2edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:23.064052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19acec1-21e3-471d-9252-274e7ffe2edd service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:23.064370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19acec1-21e3-471d-9252-274e7ffe2edd service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:23.064685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19acec1-21e3-471d-9252-274e7ffe2edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:23.074816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19acec1-21e3-471d-9252-274e7ffe2edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:23.076441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19acec1-21e3-471d-9252-274e7ffe2edd service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:23.087233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 744/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:46:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:46:23.133557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b70c2-20b3-49c0-94dd-807fbbaecb6d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:23.133888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b70c2-20b3-49c0-94dd-807fbbaecb6d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:23.134229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b70c2-20b3-49c0-94dd-807fbbaecb6d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:23.135620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 762/1506] 10.222.0.40 () {52 vars in 829 bytes} [Thu Jun 16 18:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:46:23.139640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19acec1-21e3-471d-9252-274e7ffe2edd service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:23.207832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19acec1-21e3-471d-9252-274e7ffe2edd service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:23.212929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:23.213911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:23.214291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:23.214707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] PATH_INFO: `/v3/users/47ed02f482864d709c8d06bc7f00aba7` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:23.216012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ed02f482864d709c8d06bc7f00aba7)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:23.217048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WARNING py.warnings [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:46:23.217048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: warnings.warn(msg) Jun 16 18:46:23.217048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: Jun 16 18:46:23.218264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:23.297536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ed02f482864d709c8d06bc7f00aba7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:23.320640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ed02f482864d709c8d06bc7f00aba7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:23.321503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ed02f482864d709c8d06bc7f00aba7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:23.338859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ed02f482864d709c8d06bc7f00aba7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:23.343524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:23.350860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ed02f482864d709c8d06bc7f00aba7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:23.364257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 745/1507] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:46:23 2022] DELETE /identity/v3/users/47ed02f482864d709c8d06bc7f00aba7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:46:23.368895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e688d-f967-4cb5-9d64-565a06978d68 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:23.369492 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e688d-f967-4cb5-9d64-565a06978d68 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:23.369492 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e688d-f967-4cb5-9d64-565a06978d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:23.388846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3f8e688d-f967-4cb5-9d64-565a06978d68 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:46:23.390094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3f8e688d-f967-4cb5-9d64-565a06978d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:46:23.459241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 763/1508] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:46:23.470147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:23.471814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:46:23.543017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84ebfd-ab06-4808-96d3-9f1d408fafc0 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:23.549133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19890cc6-8d1a-4407-ba1e-9a4abf27d307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:23.550270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19890cc6-8d1a-4407-ba1e-9a4abf27d307 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:23.550835 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19890cc6-8d1a-4407-ba1e-9a4abf27d307 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:23.551333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19890cc6-8d1a-4407-ba1e-9a4abf27d307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:23.568993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19890cc6-8d1a-4407-ba1e-9a4abf27d307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:23.571846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19890cc6-8d1a-4407-ba1e-9a4abf27d307 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:23.591017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 746/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:46:24.001243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e688d-f967-4cb5-9d64-565a06978d68 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:46:24.003829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3f8e688d-f967-4cb5-9d64-565a06978d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:46:24.023478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e688d-f967-4cb5-9d64-565a06978d68 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:46:24.032268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:46:24.034397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:46:24.034899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:46:24.035383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] PATH_INFO: `/v3/projects/76ddd51d6ecf48fca8737443cba72cd6` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:46:24.037616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ddd51d6ecf48fca8737443cba72cd6)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:46:24.039465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING py.warnings [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:46:24.039465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: warnings.warn(msg) Jun 16 18:46:24.039465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: Jun 16 18:46:24.041033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:46:24.137036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ddd51d6ecf48fca8737443cba72cd6', 'request_id': 'req-1eeeb2b3-e73b-4bb9-8727-2935c2034551'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:24.163228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ddd51d6ecf48fca8737443cba72cd6', 'request_id': 'req-1eeeb2b3-e73b-4bb9-8727-2935c2034551'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:24.180320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ddd51d6ecf48fca8737443cba72cd6', 'request_id': 'req-1eeeb2b3-e73b-4bb9-8727-2935c2034551'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:24.194464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] The token cache is being invalidate because project 76ddd51d6ecf48fca8737443cba72cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:46:24.194750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:24.195427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1eeeb2b3-e73b-4bb9-8727-2935c2034551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:46:24.197127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 764/1510] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:46:23 2022] DELETE /identity/v3/projects/76ddd51d6ecf48fca8737443cba72cd6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:46:33.582643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:34.190756 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:13.193046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98995ec1-8984-40ea-9e71-802f954cc738 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:13.193644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98995ec1-8984-40ea-9e71-802f954cc738 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:13.193644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98995ec1-8984-40ea-9e71-802f954cc738 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:13.194985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:13.199746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d067d-6f2d-48bc-8770-4c3f2994836f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:13.200156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d067d-6f2d-48bc-8770-4c3f2994836f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:13.200304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d067d-6f2d-48bc-8770-4c3f2994836f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:13.218727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ef3d067d-6f2d-48bc-8770-4c3f2994836f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:13.219931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ef3d067d-6f2d-48bc-8770-4c3f2994836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:13.279321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:13.451566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98995ec1-8984-40ea-9e71-802f954cc738 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:13.453286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-98995ec1-8984-40ea-9e71-802f954cc738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:13.531281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98995ec1-8984-40ea-9e71-802f954cc738 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:13.536650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0413b-3635-4c05-afa2-538c20512b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:13.537297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0413b-3635-4c05-afa2-538c20512b6f service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:13.537578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0413b-3635-4c05-afa2-538c20512b6f service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:13.537852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0413b-3635-4c05-afa2-538c20512b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:13.546530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0413b-3635-4c05-afa2-538c20512b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:13.548872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0413b-3635-4c05-afa2-538c20512b6f service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:13.558676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 748/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:14.393689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b314096-b61b-4c1e-8a60-f007596eb1b5 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:14.394225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b314096-b61b-4c1e-8a60-f007596eb1b5 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:14.394225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b314096-b61b-4c1e-8a60-f007596eb1b5 None None] PATH_INFO: `/v3` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:14.395624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 766/1514] 10.222.0.60 () {54 vars in 925 bytes} [Thu Jun 16 18:48:14 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:48:14.401681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc093ae-864a-46d8-a0fa-0eaa9a695826 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:14.402166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc093ae-864a-46d8-a0fa-0eaa9a695826 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:14.402261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc093ae-864a-46d8-a0fa-0eaa9a695826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:14.421096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-cbc093ae-864a-46d8-a0fa-0eaa9a695826 None None] MFA Rules not processed for user `167e32465f314f4caf9f8df4a4710dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:14.422293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-cbc093ae-864a-46d8-a0fa-0eaa9a695826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:14.455131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02905514-ea09-416b-87a6-4e080a3550b8 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:14.455542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02905514-ea09-416b-87a6-4e080a3550b8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:14.455826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02905514-ea09-416b-87a6-4e080a3550b8 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:14.457244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 767/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:14.462180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332fda2-d9da-42ae-bde1-df1e90cf7d79 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:14.462510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332fda2-d9da-42ae-bde1-df1e90cf7d79 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:14.462796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332fda2-d9da-42ae-bde1-df1e90cf7d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:14.481609 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4332fda2-d9da-42ae-bde1-df1e90cf7d79 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:14.482853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4332fda2-d9da-42ae-bde1-df1e90cf7d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:14.489262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 749/1516] 10.222.0.60 () {58 vars in 1015 bytes} [Thu Jun 16 18:48:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:14.491666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 768/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:48:14.646507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc093ae-864a-46d8-a0fa-0eaa9a695826 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:14.659349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc093ae-864a-46d8-a0fa-0eaa9a695826 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:14.664880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77e310-7d00-4912-aa37-436482429a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:14.665561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77e310-7d00-4912-aa37-436482429a3c service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:14.665869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77e310-7d00-4912-aa37-436482429a3c service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:14.666147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77e310-7d00-4912-aa37-436482429a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:14.675585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77e310-7d00-4912-aa37-436482429a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:14.677492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77e310-7d00-4912-aa37-436482429a3c service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:14.687084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 750/1518] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:18.242066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa8593-0d79-4714-a603-9dbc9d832e7d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:18.242744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa8593-0d79-4714-a603-9dbc9d832e7d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:18.242744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa8593-0d79-4714-a603-9dbc9d832e7d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:18.243940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 769/1519] 10.222.0.40 () {54 vars in 960 bytes} [Thu Jun 16 18:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:18.249298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f3d8-078c-4efb-b7c1-4816660c6c3e None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:18.249856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f3d8-078c-4efb-b7c1-4816660c6c3e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:18.249856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f3d8-078c-4efb-b7c1-4816660c6c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:18.273087 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-26b5f3d8-078c-4efb-b7c1-4816660c6c3e None None] MFA Rules not processed for user `167e32465f314f4caf9f8df4a4710dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:18.274298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-26b5f3d8-078c-4efb-b7c1-4816660c6c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:18.283062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 751/1520] 10.222.0.40 () {58 vars in 1057 bytes} [Thu Jun 16 18:48:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:18.290989 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa8593-0d79-4714-a603-9dbc9d832e7d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:18.305544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa8593-0d79-4714-a603-9dbc9d832e7d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:18.310991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b356f5-d784-4dd7-b6af-ba492422bb6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:18.311858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b356f5-d784-4dd7-b6af-ba492422bb6e service placement] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:18.312144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b356f5-d784-4dd7-b6af-ba492422bb6e service placement] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:18.312420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b356f5-d784-4dd7-b6af-ba492422bb6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:18.322551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b356f5-d784-4dd7-b6af-ba492422bb6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:18.324144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b356f5-d784-4dd7-b6af-ba492422bb6e service placement] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:18.334893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 770/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:25.995069 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374ee4b-cb04-4642-bf72-4ad483e310e7 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:25.995639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374ee4b-cb04-4642-bf72-4ad483e310e7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:25.995639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374ee4b-cb04-4642-bf72-4ad483e310e7 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:25.996986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:26.002279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcacd46-d343-4e0b-9d67-d823d4492b12 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:26.002748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcacd46-d343-4e0b-9d67-d823d4492b12 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:26.002858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcacd46-d343-4e0b-9d67-d823d4492b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:26.021069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-cfcacd46-d343-4e0b-9d67-d823d4492b12 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:26.022333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-cfcacd46-d343-4e0b-9d67-d823d4492b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:26.030087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:48:26.184331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374ee4b-cb04-4642-bf72-4ad483e310e7 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:26.199179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374ee4b-cb04-4642-bf72-4ad483e310e7 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:26.205143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219a70-957d-47e4-83fa-1d3d5b32c7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:26.205782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219a70-957d-47e4-83fa-1d3d5b32c7c8 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:26.206067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219a70-957d-47e4-83fa-1d3d5b32c7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:26.206345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219a70-957d-47e4-83fa-1d3d5b32c7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:26.214485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219a70-957d-47e4-83fa-1d3d5b32c7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:26.216099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219a70-957d-47e4-83fa-1d3d5b32c7c8 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:26.225392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 753/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:27.087839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941b64b-02dc-4c6c-a64c-8556bf39edfb None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:27.088386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941b64b-02dc-4c6c-a64c-8556bf39edfb None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:27.088386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941b64b-02dc-4c6c-a64c-8556bf39edfb None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:27.089786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 18:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:27.095166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbe9a4-e99d-419d-acfa-38629541cbdb None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:27.095574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbe9a4-e99d-419d-acfa-38629541cbdb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:27.095718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbe9a4-e99d-419d-acfa-38629541cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:27.113148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-45bbe9a4-e99d-419d-acfa-38629541cbdb None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:27.114311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-45bbe9a4-e99d-419d-acfa-38629541cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:27.122027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 18:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:27.274360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941b64b-02dc-4c6c-a64c-8556bf39edfb None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:27.288721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941b64b-02dc-4c6c-a64c-8556bf39edfb None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:27.294091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc2700-1301-475c-a38e-3d2b2b0d373c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:27.294776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2700-1301-475c-a38e-3d2b2b0d373c service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:27.295056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2700-1301-475c-a38e-3d2b2b0d373c service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:27.295336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc2700-1301-475c-a38e-3d2b2b0d373c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:27.305289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2700-1301-475c-a38e-3d2b2b0d373c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:27.306943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc2700-1301-475c-a38e-3d2b2b0d373c service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:27.318278 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 773/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:31.763623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02e6c-dfc1-41e1-b48a-d9ee111c4de6 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:31.764174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02e6c-dfc1-41e1-b48a-d9ee111c4de6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:31.764174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa02e6c-dfc1-41e1-b48a-d9ee111c4de6 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:31.765465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:31.771421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f88a-78fd-4e31-9081-943dee407f2f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:31.771883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f88a-78fd-4e31-9081-943dee407f2f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:31.772011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68f88a-78fd-4e31-9081-943dee407f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:31.789478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ee68f88a-78fd-4e31-9081-943dee407f2f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:31.790689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ee68f88a-78fd-4e31-9081-943dee407f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:31.798353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:48:31.836034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa02e6c-dfc1-41e1-b48a-d9ee111c4de6 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:31.837741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-eaa02e6c-dfc1-41e1-b48a-d9ee111c4de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:31.884571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:31.897783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa02e6c-dfc1-41e1-b48a-d9ee111c4de6 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:31.901351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e746c4-9b29-471c-bd51-10611bd0a5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:31.902005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e746c4-9b29-471c-bd51-10611bd0a5fa service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:31.902291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e746c4-9b29-471c-bd51-10611bd0a5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:31.902602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e746c4-9b29-471c-bd51-10611bd0a5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:31.912091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e746c4-9b29-471c-bd51-10611bd0a5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:31.913526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e746c4-9b29-471c-bd51-10611bd0a5fa service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:31.923598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 756/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:34.098551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af9fb-5239-4051-aa5d-63cf54f92e45 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:34.099030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af9fb-5239-4051-aa5d-63cf54f92e45 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:34.099142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af9fb-5239-4051-aa5d-63cf54f92e45 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:34.100520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:34.105922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12b0c8-e50a-4292-954e-91515ea6692a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:34.106415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12b0c8-e50a-4292-954e-91515ea6692a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:34.106512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12b0c8-e50a-4292-954e-91515ea6692a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:34.126072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ce12b0c8-e50a-4292-954e-91515ea6692a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:34.127330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ce12b0c8-e50a-4292-954e-91515ea6692a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:34.135809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:34.175179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39af9fb-5239-4051-aa5d-63cf54f92e45 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:34.177156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c39af9fb-5239-4051-aa5d-63cf54f92e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:34.192788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39af9fb-5239-4051-aa5d-63cf54f92e45 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:34.196336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd132c7e-ebb1-4b9d-8af7-14b1c741fc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:34.197005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd132c7e-ebb1-4b9d-8af7-14b1c741fc9f service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:34.197286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd132c7e-ebb1-4b9d-8af7-14b1c741fc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:34.197561 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd132c7e-ebb1-4b9d-8af7-14b1c741fc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:34.203576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=51 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:34.208244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd132c7e-ebb1-4b9d-8af7-14b1c741fc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:34.209475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd132c7e-ebb1-4b9d-8af7-14b1c741fc9f service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:34.219224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 776/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:37.874924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717509-db8b-47d4-89c4-32a887c6461b None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:37.875516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717509-db8b-47d4-89c4-32a887c6461b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:37.875516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717509-db8b-47d4-89c4-32a887c6461b None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:37.876794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:37.882230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677cd23-049c-47ee-a202-368c3b26e8ce None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:37.882770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677cd23-049c-47ee-a202-368c3b26e8ce None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:37.882887 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677cd23-049c-47ee-a202-368c3b26e8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:37.902268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e677cd23-049c-47ee-a202-368c3b26e8ce None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:37.903540 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e677cd23-049c-47ee-a202-368c3b26e8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:37.912136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:38.182318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19717509-db8b-47d4-89c4-32a887c6461b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:38.184040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-19717509-db8b-47d4-89c4-32a887c6461b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:38.244388 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19717509-db8b-47d4-89c4-32a887c6461b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:38.247956 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a8d7f-6b4c-4854-959b-442ad40f0eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:38.248638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a8d7f-6b4c-4854-959b-442ad40f0eaa service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:38.248925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a8d7f-6b4c-4854-959b-442ad40f0eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:38.249207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a8d7f-6b4c-4854-959b-442ad40f0eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:38.259268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a8d7f-6b4c-4854-959b-442ad40f0eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:38.260715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a8d7f-6b4c-4854-959b-442ad40f0eaa service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:38.271267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 759/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:40.419718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f60eb-ca70-4838-befd-d89deafbdfc4 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:40.420250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f60eb-ca70-4838-befd-d89deafbdfc4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:40.420250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f60eb-ca70-4838-befd-d89deafbdfc4 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:40.421565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 18:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:48:40.427062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253e6ee-96a8-4f6a-8695-40898c74417f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:40.427538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253e6ee-96a8-4f6a-8695-40898c74417f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:40.427649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253e6ee-96a8-4f6a-8695-40898c74417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:40.446287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f253e6ee-96a8-4f6a-8695-40898c74417f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:48:40.447524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f253e6ee-96a8-4f6a-8695-40898c74417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:40.456240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 18:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:48:40.724720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f60eb-ca70-4838-befd-d89deafbdfc4 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:48:40.726621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-893f60eb-ca70-4838-befd-d89deafbdfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:48:40.740682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f60eb-ca70-4838-befd-d89deafbdfc4 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:48:40.744291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234b390-602d-4330-a118-1a9ba4154e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:48:40.744953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b390-602d-4330-a118-1a9ba4154e1b service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:48:40.745245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b390-602d-4330-a118-1a9ba4154e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:48:40.745530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b390-602d-4330-a118-1a9ba4154e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:48:40.756326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234b390-602d-4330-a118-1a9ba4154e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:48:40.757775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234b390-602d-4330-a118-1a9ba4154e1b service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:48:40.768300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 779/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:48:50.440901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=39 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:50.763686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=12 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:13.396546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f37fe4-38fb-4526-bd0f-72b8089ddea7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.397714 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f37fe4-38fb-4526-bd0f-72b8089ddea7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.398287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f37fe4-38fb-4526-bd0f-72b8089ddea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.435037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-98f37fe4-38fb-4526-bd0f-72b8089ddea7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.436792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-98f37fe4-38fb-4526-bd0f-72b8089ddea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.446756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 761/1540] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.452107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d354-a3b0-4656-934a-314f0f555b67 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.452696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d354-a3b0-4656-934a-314f0f555b67 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.452696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573d354-a3b0-4656-934a-314f0f555b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.459152 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115e5f7-31c1-4722-8aea-5679b05de702 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.459886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115e5f7-31c1-4722-8aea-5679b05de702 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.460403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115e5f7-31c1-4722-8aea-5679b05de702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.480702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d573d354-a3b0-4656-934a-314f0f555b67 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.483138 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d573d354-a3b0-4656-934a-314f0f555b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.493142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-b115e5f7-31c1-4722-8aea-5679b05de702 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.494701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b115e5f7-31c1-4722-8aea-5679b05de702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.502854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 780/1541] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.513983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dcef9-f359-4009-8ca4-4e7e79fb0855 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.514549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dcef9-f359-4009-8ca4-4e7e79fb0855 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.515044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dcef9-f359-4009-8ca4-4e7e79fb0855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.518773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 762/1542] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:50:13.525956 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115e5f7-31c1-4722-8aea-5679b05de702 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:13.547494 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115e5f7-31c1-4722-8aea-5679b05de702 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:13.557373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-bb2dcef9-f359-4009-8ca4-4e7e79fb0855 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.558650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bb2dcef9-f359-4009-8ca4-4e7e79fb0855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.559856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:13.560890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.561438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.562115 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.563214 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:13.563780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:13.565204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WARNING py.warnings [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:50:13.565204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: warnings.warn(msg) Jun 16 18:50:13.565204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: Jun 16 18:50:13.570154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:13.579591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 781/1543] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.582776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83759d0a-2117-4941-88ae-2d73922a9550 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.582776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83759d0a-2117-4941-88ae-2d73922a9550 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.582776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83759d0a-2117-4941-88ae-2d73922a9550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.593559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 763/1544] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:13.595009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:13.613948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-83759d0a-2117-4941-88ae-2d73922a9550 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.615581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-83759d0a-2117-4941-88ae-2d73922a9550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.618872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0e642-1842-43bf-b7ab-376e809e593b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:13.627669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42e16d-08d0-49ea-876c-e186db6d72a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:13.628689 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42e16d-08d0-49ea-876c-e186db6d72a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.629104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42e16d-08d0-49ea-876c-e186db6d72a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.629575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42e16d-08d0-49ea-876c-e186db6d72a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.630443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42e16d-08d0-49ea-876c-e186db6d72a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:13.630861 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42e16d-08d0-49ea-876c-e186db6d72a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:13.632703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42e16d-08d0-49ea-876c-e186db6d72a1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:13.633629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 782/1545] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.635299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0c777-cf92-44d7-a503-0a78a94e2b1a None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.635780 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0c777-cf92-44d7-a503-0a78a94e2b1a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.636215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0c777-cf92-44d7-a503-0a78a94e2b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.663998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 764/1546] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:13.664837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42e16d-08d0-49ea-876c-e186db6d72a1 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:13.677132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-07d0c777-cf92-44d7-a503-0a78a94e2b1a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.678441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-07d0c777-cf92-44d7-a503-0a78a94e2b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.691766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42e16d-08d0-49ea-876c-e186db6d72a1 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:13.695930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 783/1547] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.697695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326c10b-f7b1-4e03-b6ab-9d3da09bd835 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.697993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326c10b-f7b1-4e03-b6ab-9d3da09bd835 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.698276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326c10b-f7b1-4e03-b6ab-9d3da09bd835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.703877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28297d-560e-4159-906d-5f236a716a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:13.704566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28297d-560e-4159-906d-5f236a716a1a admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.704942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28297d-560e-4159-906d-5f236a716a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.705434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28297d-560e-4159-906d-5f236a716a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.706131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28297d-560e-4159-906d-5f236a716a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:13.708238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28297d-560e-4159-906d-5f236a716a1a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:13.743523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d326c10b-f7b1-4e03-b6ab-9d3da09bd835 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.745178 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d326c10b-f7b1-4e03-b6ab-9d3da09bd835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.754154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 784/1548] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.755807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8e40-03a7-4ad0-8897-95439fe8bab9 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.756355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8e40-03a7-4ad0-8897-95439fe8bab9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.756696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8e40-03a7-4ad0-8897-95439fe8bab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.767566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 765/1549] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:13.767566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28297d-560e-4159-906d-5f236a716a1a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:13.776728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1b4f8e40-03a7-4ad0-8897-95439fe8bab9 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.778562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1b4f8e40-03a7-4ad0-8897-95439fe8bab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.850440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28297d-560e-4159-906d-5f236a716a1a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:13.855431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d4d6b-4ab4-41c8-8e90-28ad7af8e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:13.856434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 785/1550] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.856658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d4d6b-4ab4-41c8-8e90-28ad7af8e619 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.856935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d4d6b-4ab4-41c8-8e90-28ad7af8e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.857217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d4d6b-4ab4-41c8-8e90-28ad7af8e619 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.857810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae5b7-fbf2-4518-84ac-160a28ee1d04 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.858009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d4d6b-4ab4-41c8-8e90-28ad7af8e619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:13.858125 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae5b7-fbf2-4518-84ac-160a28ee1d04 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.858365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae5b7-fbf2-4518-84ac-160a28ee1d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.860237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d4d6b-4ab4-41c8-8e90-28ad7af8e619 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:13.879263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-fd3ae5b7-fbf2-4518-84ac-160a28ee1d04 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.880743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-fd3ae5b7-fbf2-4518-84ac-160a28ee1d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.889407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 786/1551] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.890753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cfdae-3b1b-4859-9fb8-d16cf0ccb25f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.890882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 766/1552] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:13.891142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cfdae-3b1b-4859-9fb8-d16cf0ccb25f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.891439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cfdae-3b1b-4859-9fb8-d16cf0ccb25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.892314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b73b-eed2-4f9b-b058-2d5e946df760 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:13.892602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b73b-eed2-4f9b-b058-2d5e946df760 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:13.892899 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b73b-eed2-4f9b-b058-2d5e946df760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:13.911315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3d5cfdae-3b1b-4859-9fb8-d16cf0ccb25f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.911553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7451b73b-eed2-4f9b-b058-2d5e946df760 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:13.912554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7451b73b-eed2-4f9b-b058-2d5e946df760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.913032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3d5cfdae-3b1b-4859-9fb8-d16cf0ccb25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:13.974579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 787/1553] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.975418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cfdae-3b1b-4859-9fb8-d16cf0ccb25f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:13.994305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 767/1554] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:13.996083 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b73b-eed2-4f9b-b058-2d5e946df760 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:13.997375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cfdae-3b1b-4859-9fb8-d16cf0ccb25f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.004192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f945b5a-0ef1-449d-ae3e-aa58cab2a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.005224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f945b5a-0ef1-449d-ae3e-aa58cab2a218 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.005676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f945b5a-0ef1-449d-ae3e-aa58cab2a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.006108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f945b5a-0ef1-449d-ae3e-aa58cab2a218 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.007362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f945b5a-0ef1-449d-ae3e-aa58cab2a218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:14.007884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f945b5a-0ef1-449d-ae3e-aa58cab2a218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.010660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f945b5a-0ef1-449d-ae3e-aa58cab2a218 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.012481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b73b-eed2-4f9b-b058-2d5e946df760 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.019943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3abd04-2952-4e49-8ad7-cc30226af13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.021081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3abd04-2952-4e49-8ad7-cc30226af13c admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.021568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3abd04-2952-4e49-8ad7-cc30226af13c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.022234 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3abd04-2952-4e49-8ad7-cc30226af13c admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.023388 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3abd04-2952-4e49-8ad7-cc30226af13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.025235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WARNING py.warnings [None req-0e3abd04-2952-4e49-8ad7-cc30226af13c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:50:14.025235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: warnings.warn(msg) Jun 16 18:50:14.025235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: Jun 16 18:50:14.028096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3abd04-2952-4e49-8ad7-cc30226af13c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.030581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 788/1555] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:14.032430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02415ed-a775-4f62-8d15-54baee63f053 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.032745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02415ed-a775-4f62-8d15-54baee63f053 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.033057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02415ed-a775-4f62-8d15-54baee63f053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.054607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-c02415ed-a775-4f62-8d15-54baee63f053 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:14.055802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c02415ed-a775-4f62-8d15-54baee63f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:14.057536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 768/1556] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:13 2022] POST /identity/v3/users => generated 293 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.059726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81096a-f265-4b86-961d-a6dce27932c0 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.060121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81096a-f265-4b86-961d-a6dce27932c0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.060493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81096a-f265-4b86-961d-a6dce27932c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.067295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 789/1557] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:14.067929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02415ed-a775-4f62-8d15-54baee63f053 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.078859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02415ed-a775-4f62-8d15-54baee63f053 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.081737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:14.086163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be6481-180d-45e8-a552-940cbd67d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.086887 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be6481-180d-45e8-a552-940cbd67d15d admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.087149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be6481-180d-45e8-a552-940cbd67d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.087457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be6481-180d-45e8-a552-940cbd67d15d admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.088357 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be6481-180d-45e8-a552-940cbd67d15d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:14.088910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be6481-180d-45e8-a552-940cbd67d15d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.089321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ee81096a-f265-4b86-961d-a6dce27932c0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:14.091456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be6481-180d-45e8-a552-940cbd67d15d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.091814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ee81096a-f265-4b86-961d-a6dce27932c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:14.104899 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 769/1558] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:14.106838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81096a-f265-4b86-961d-a6dce27932c0 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.118655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 790/1559] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:14.118655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd94dd-987d-45fc-88ba-5002010ef524 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.118655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd94dd-987d-45fc-88ba-5002010ef524 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.118655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd94dd-987d-45fc-88ba-5002010ef524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.124674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81096a-f265-4b86-961d-a6dce27932c0 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.130211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574219b1-e100-468f-93b1-2c4d1b67f8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.131036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574219b1-e100-468f-93b1-2c4d1b67f8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.131490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574219b1-e100-468f-93b1-2c4d1b67f8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.131896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574219b1-e100-468f-93b1-2c4d1b67f8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.132662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574219b1-e100-468f-93b1-2c4d1b67f8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.134879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574219b1-e100-468f-93b1-2c4d1b67f8f3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.141691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-00cd94dd-987d-45fc-88ba-5002010ef524 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:14.142778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-00cd94dd-987d-45fc-88ba-5002010ef524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:14.155179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 791/1560] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:14.157069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52049df-9d7d-4dca-90b8-998d62084284 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.157451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52049df-9d7d-4dca-90b8-998d62084284 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.157807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52049df-9d7d-4dca-90b8-998d62084284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.166436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 770/1561] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/users => generated 286 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.167525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574219b1-e100-468f-93b1-2c4d1b67f8f3 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.179791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574219b1-e100-468f-93b1-2c4d1b67f8f3 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.183284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-a52049df-9d7d-4dca-90b8-998d62084284 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:14.184975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a52049df-9d7d-4dca-90b8-998d62084284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:14.187283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f6043-7bba-4ec4-9ca0-8d7b969acdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.188452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6043-7bba-4ec4-9ca0-8d7b969acdd0 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.188885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6043-7bba-4ec4-9ca0-8d7b969acdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.189542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f6043-7bba-4ec4-9ca0-8d7b969acdd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.191154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f6043-7bba-4ec4-9ca0-8d7b969acdd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.195252 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f6043-7bba-4ec4-9ca0-8d7b969acdd0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.198349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 792/1562] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:14.199789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52049df-9d7d-4dca-90b8-998d62084284 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.212602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52049df-9d7d-4dca-90b8-998d62084284 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.219378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87917a8a-ecd5-4a50-a78b-607a0040483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.220287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87917a8a-ecd5-4a50-a78b-607a0040483a admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.220669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87917a8a-ecd5-4a50-a78b-607a0040483a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.221035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87917a8a-ecd5-4a50-a78b-607a0040483a admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.222036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87917a8a-ecd5-4a50-a78b-607a0040483a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.224199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87917a8a-ecd5-4a50-a78b-607a0040483a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.227401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 771/1563] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.228653 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a92e7-a0a4-4c6c-8657-ede1584f7008 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.228944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a92e7-a0a4-4c6c-8657-ede1584f7008 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.229220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a92e7-a0a4-4c6c-8657-ede1584f7008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.241968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 793/1564] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:14.241968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87917a8a-ecd5-4a50-a78b-607a0040483a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.246226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:14.248430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d68a92e7-a0a4-4c6c-8657-ede1584f7008 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:14.249654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d68a92e7-a0a4-4c6c-8657-ede1584f7008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:14.250046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87917a8a-ecd5-4a50-a78b-607a0040483a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.317328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 772/1565] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:14.318185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a92e7-a0a4-4c6c-8657-ede1584f7008 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.327815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fbf4d-48f7-4f7b-9eb9-dc0638172da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.328454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a92e7-a0a4-4c6c-8657-ede1584f7008 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.328585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fbf4d-48f7-4f7b-9eb9-dc0638172da2 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.328798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fbf4d-48f7-4f7b-9eb9-dc0638172da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.329075 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fbf4d-48f7-4f7b-9eb9-dc0638172da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.329845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fbf4d-48f7-4f7b-9eb9-dc0638172da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:14.330154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fbf4d-48f7-4f7b-9eb9-dc0638172da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.331823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fbf4d-48f7-4f7b-9eb9-dc0638172da2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.333844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7826e8-9127-47ce-8e4a-3f6d71fdaead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.334613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7826e8-9127-47ce-8e4a-3f6d71fdaead admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.334967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7826e8-9127-47ce-8e4a-3f6d71fdaead admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.335452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7826e8-9127-47ce-8e4a-3f6d71fdaead admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.336158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7826e8-9127-47ce-8e4a-3f6d71fdaead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.338100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7826e8-9127-47ce-8e4a-3f6d71fdaead admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.346206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 794/1566] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:14.347442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fbf4d-48f7-4f7b-9eb9-dc0638172da2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.358323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fbf4d-48f7-4f7b-9eb9-dc0638172da2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.363750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad737309-b526-4a5f-a217-b20adc23cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.364676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad737309-b526-4a5f-a217-b20adc23cf46 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.365107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad737309-b526-4a5f-a217-b20adc23cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.365393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad737309-b526-4a5f-a217-b20adc23cf46 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.366128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad737309-b526-4a5f-a217-b20adc23cf46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:14.366478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad737309-b526-4a5f-a217-b20adc23cf46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.367258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 773/1567] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.370670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad737309-b526-4a5f-a217-b20adc23cf46 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.370773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7826e8-9127-47ce-8e4a-3f6d71fdaead admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.389567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 795/1568] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:14.390855 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad737309-b526-4a5f-a217-b20adc23cf46 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.404818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad737309-b526-4a5f-a217-b20adc23cf46 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.441131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7826e8-9127-47ce-8e4a-3f6d71fdaead admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.445915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f698cc-27e4-468b-9580-a7516767fb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.446627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f698cc-27e4-468b-9580-a7516767fb49 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.446926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f698cc-27e4-468b-9580-a7516767fb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.447203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f698cc-27e4-468b-9580-a7516767fb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.447968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f698cc-27e4-468b-9580-a7516767fb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.450145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f698cc-27e4-468b-9580-a7516767fb49 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.464413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 774/1569] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:14.464413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f698cc-27e4-468b-9580-a7516767fb49 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.466177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b735ed5-13b1-40db-8c9d-b4ef919c083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.466957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b735ed5-13b1-40db-8c9d-b4ef919c083b admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.467240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b735ed5-13b1-40db-8c9d-b4ef919c083b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.467516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b735ed5-13b1-40db-8c9d-b4ef919c083b admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.468241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b735ed5-13b1-40db-8c9d-b4ef919c083b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:14.468551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b735ed5-13b1-40db-8c9d-b4ef919c083b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.470146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b735ed5-13b1-40db-8c9d-b4ef919c083b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.475138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f698cc-27e4-468b-9580-a7516767fb49 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.479988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7ed0-1230-4016-819b-e2205ba676ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.480731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7ed0-1230-4016-819b-e2205ba676ae admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.481082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7ed0-1230-4016-819b-e2205ba676ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.481420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7ed0-1230-4016-819b-e2205ba676ae admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.482213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7ed0-1230-4016-819b-e2205ba676ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.482774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 796/1570] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:14.483465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b735ed5-13b1-40db-8c9d-b4ef919c083b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.484295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7ed0-1230-4016-819b-e2205ba676ae admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.493541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b735ed5-13b1-40db-8c9d-b4ef919c083b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.499088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cdc72-6bfc-4a73-b3ee-cecc1bbf83b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.499762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cdc72-6bfc-4a73-b3ee-cecc1bbf83b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.500045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cdc72-6bfc-4a73-b3ee-cecc1bbf83b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.500348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cdc72-6bfc-4a73-b3ee-cecc1bbf83b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.501513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cdc72-6bfc-4a73-b3ee-cecc1bbf83b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.503252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cdc72-6bfc-4a73-b3ee-cecc1bbf83b2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.509266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 775/1571] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.509266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7ed0-1230-4016-819b-e2205ba676ae admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.518888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 797/1572] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:14.518888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cdc72-6bfc-4a73-b3ee-cecc1bbf83b2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.523286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7ed0-1230-4016-819b-e2205ba676ae admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.525973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cdc72-6bfc-4a73-b3ee-cecc1bbf83b2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.528863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c9f8a-18d5-4e5c-a755-93a937abc35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.529644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c9f8a-18d5-4e5c-a755-93a937abc35b admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.530060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c9f8a-18d5-4e5c-a755-93a937abc35b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.530352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c9f8a-18d5-4e5c-a755-93a937abc35b admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.531170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c9f8a-18d5-4e5c-a755-93a937abc35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:14.531485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c9f8a-18d5-4e5c-a755-93a937abc35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.531655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ba3d1-c8c6-4781-86c2-45c83ae0aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.532168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ba3d1-c8c6-4781-86c2-45c83ae0aa93 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.532446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ba3d1-c8c6-4781-86c2-45c83ae0aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.532726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ba3d1-c8c6-4781-86c2-45c83ae0aa93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.533171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c9f8a-18d5-4e5c-a755-93a937abc35b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.533414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ba3d1-c8c6-4781-86c2-45c83ae0aa93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.534451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING py.warnings [None req-1c8ba3d1-c8c6-4781-86c2-45c83ae0aa93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:50:14.534451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: warnings.warn(msg) Jun 16 18:50:14.534451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: Jun 16 18:50:14.535635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ba3d1-c8c6-4781-86c2-45c83ae0aa93 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.550472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 776/1573] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:14.551434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c9f8a-18d5-4e5c-a755-93a937abc35b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.558408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:14.562707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c9f8a-18d5-4e5c-a755-93a937abc35b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.567235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 798/1574] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.568084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ba3d1-c8c6-4781-86c2-45c83ae0aa93 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.569683 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de9dd4-315c-457e-9b11-5348be1d87ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.570922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9dd4-315c-457e-9b11-5348be1d87ce admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.571246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9dd4-315c-457e-9b11-5348be1d87ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.571641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9dd4-315c-457e-9b11-5348be1d87ce admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.572233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de9dd4-315c-457e-9b11-5348be1d87ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.574236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de9dd4-315c-457e-9b11-5348be1d87ce admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.604976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 777/1575] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.604976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de9dd4-315c-457e-9b11-5348be1d87ce admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.612071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de9dd4-315c-457e-9b11-5348be1d87ce admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.627928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:14.643579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ba3d1-c8c6-4781-86c2-45c83ae0aa93 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.648266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb87de-ba8c-4d1b-8aaa-e4dd1e494569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.648939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb87de-ba8c-4d1b-8aaa-e4dd1e494569 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.649230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb87de-ba8c-4d1b-8aaa-e4dd1e494569 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.649499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb87de-ba8c-4d1b-8aaa-e4dd1e494569 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.650196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb87de-ba8c-4d1b-8aaa-e4dd1e494569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.652144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb87de-ba8c-4d1b-8aaa-e4dd1e494569 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.672548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2c9ef-fa6f-41be-b8b5-78a32aa3cc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.673226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2c9ef-fa6f-41be-b8b5-78a32aa3cc3d admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.673837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2c9ef-fa6f-41be-b8b5-78a32aa3cc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.674044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2c9ef-fa6f-41be-b8b5-78a32aa3cc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.674810 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2c9ef-fa6f-41be-b8b5-78a32aa3cc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.676427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2c9ef-fa6f-41be-b8b5-78a32aa3cc3d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.679712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 799/1576] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.680557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb87de-ba8c-4d1b-8aaa-e4dd1e494569 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.687666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 778/1577] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:14.688577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2c9ef-fa6f-41be-b8b5-78a32aa3cc3d admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.698730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2c9ef-fa6f-41be-b8b5-78a32aa3cc3d admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.744688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb87de-ba8c-4d1b-8aaa-e4dd1e494569 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.750032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d89ea-0794-4999-9788-549fffa3d7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.750737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d89ea-0794-4999-9788-549fffa3d7ab admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.751039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d89ea-0794-4999-9788-549fffa3d7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.751309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d89ea-0794-4999-9788-549fffa3d7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.752001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d89ea-0794-4999-9788-549fffa3d7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.753912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d89ea-0794-4999-9788-549fffa3d7ab admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.758910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828da00-bdb1-4101-a91b-c426f053753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.759583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828da00-bdb1-4101-a91b-c426f053753d admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.759869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828da00-bdb1-4101-a91b-c426f053753d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.760149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828da00-bdb1-4101-a91b-c426f053753d admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.760874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828da00-bdb1-4101-a91b-c426f053753d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.763093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828da00-bdb1-4101-a91b-c426f053753d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.773924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 779/1578] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:14.775092 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828da00-bdb1-4101-a91b-c426f053753d admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.781719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 800/1579] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.783057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d89ea-0794-4999-9788-549fffa3d7ab admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.785455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828da00-bdb1-4101-a91b-c426f053753d admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.843669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47932f2e-9772-42aa-b38e-e9d7e5c25ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.845236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47932f2e-9772-42aa-b38e-e9d7e5c25ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.845721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47932f2e-9772-42aa-b38e-e9d7e5c25ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.846005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47932f2e-9772-42aa-b38e-e9d7e5c25ecb admin admin] PATH_INFO: `/v3/projects/f047c816ad8a4a46be5efc220d8ca33d/users/43b0bb5ce8824afea4ec10d2235be0c4/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.847811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d89ea-0794-4999-9788-549fffa3d7ab admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.852462 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effc4ac-827e-4903-9d1a-fa129a5a229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.853157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effc4ac-827e-4903-9d1a-fa129a5a229f admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.853594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effc4ac-827e-4903-9d1a-fa129a5a229f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.853867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effc4ac-827e-4903-9d1a-fa129a5a229f admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.854594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effc4ac-827e-4903-9d1a-fa129a5a229f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.856545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effc4ac-827e-4903-9d1a-fa129a5a229f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.861105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47932f2e-9772-42aa-b38e-e9d7e5c25ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f047c816ad8a4a46be5efc220d8ca33d, user_id=43b0bb5ce8824afea4ec10d2235be0c4, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.863851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47932f2e-9772-42aa-b38e-e9d7e5c25ecb admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.883110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 780/1580] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:14 2022] PUT /identity/v3/projects/f047c816ad8a4a46be5efc220d8ca33d/users/43b0bb5ce8824afea4ec10d2235be0c4/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:14.884006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47932f2e-9772-42aa-b38e-e9d7e5c25ecb admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.888756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:14.890063 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 801/1581] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.890972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effc4ac-827e-4903-9d1a-fa129a5a229f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.941577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:14.956302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47932f2e-9772-42aa-b38e-e9d7e5c25ecb admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.962212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f8aa1-4f6f-49d5-bd30-57c4d4a743db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.962989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f8aa1-4f6f-49d5-bd30-57c4d4a743db admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.964270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effc4ac-827e-4903-9d1a-fa129a5a229f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:14.964444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f8aa1-4f6f-49d5-bd30-57c4d4a743db admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.964651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f8aa1-4f6f-49d5-bd30-57c4d4a743db admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.965785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f8aa1-4f6f-49d5-bd30-57c4d4a743db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.967916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f8aa1-4f6f-49d5-bd30-57c4d4a743db admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.969721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bce7e-7fba-43e4-9536-c50ac5ddd23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:14.970417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bce7e-7fba-43e4-9536-c50ac5ddd23f admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:14.970703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bce7e-7fba-43e4-9536-c50ac5ddd23f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:14.970980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bce7e-7fba-43e4-9536-c50ac5ddd23f admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:14.971707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bce7e-7fba-43e4-9536-c50ac5ddd23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:14.973288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bce7e-7fba-43e4-9536-c50ac5ddd23f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:14.985171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 802/1582] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:14.986005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bce7e-7fba-43e4-9536-c50ac5ddd23f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.990517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 781/1583] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:14.991556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f8aa1-4f6f-49d5-bd30-57c4d4a743db admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:14.999261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bce7e-7fba-43e4-9536-c50ac5ddd23f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.003331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f8aa1-4f6f-49d5-bd30-57c4d4a743db admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.004079 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff17d7-1099-4f95-ae0e-a7b69a792856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.004750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff17d7-1099-4f95-ae0e-a7b69a792856 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.005043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff17d7-1099-4f95-ae0e-a7b69a792856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.005323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff17d7-1099-4f95-ae0e-a7b69a792856 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.006014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff17d7-1099-4f95-ae0e-a7b69a792856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.007967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff17d7-1099-4f95-ae0e-a7b69a792856 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.008119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2918fbb-38f0-482e-a2c4-c3af059079f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.008875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2918fbb-38f0-482e-a2c4-c3af059079f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.009161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2918fbb-38f0-482e-a2c4-c3af059079f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.009514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2918fbb-38f0-482e-a2c4-c3af059079f4 admin admin] PATH_INFO: `/v3/projects/20e129812a3e4e2e8a0e3b5af697b959/users/73bd01db605349b089fb01e0711b89ab/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.026484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2918fbb-38f0-482e-a2c4-c3af059079f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e129812a3e4e2e8a0e3b5af697b959, user_id=73bd01db605349b089fb01e0711b89ab, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.029205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2918fbb-38f0-482e-a2c4-c3af059079f4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.029978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 803/1584] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:14 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:15.030752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff17d7-1099-4f95-ae0e-a7b69a792856 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.040872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff17d7-1099-4f95-ae0e-a7b69a792856 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.045343 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 782/1585] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:14 2022] PUT /identity/v3/projects/20e129812a3e4e2e8a0e3b5af697b959/users/73bd01db605349b089fb01e0711b89ab/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:15.046556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2918fbb-38f0-482e-a2c4-c3af059079f4 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.111022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a25de-a1c5-4376-8991-fcde0ec5f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.111738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a25de-a1c5-4376-8991-fcde0ec5f065 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.112024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a25de-a1c5-4376-8991-fcde0ec5f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.112303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a25de-a1c5-4376-8991-fcde0ec5f065 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.113119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a25de-a1c5-4376-8991-fcde0ec5f065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.114910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a25de-a1c5-4376-8991-fcde0ec5f065 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.125564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2918fbb-38f0-482e-a2c4-c3af059079f4 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.130617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 804/1586] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.130617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a25de-a1c5-4376-8991-fcde0ec5f065 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.134596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143b6fa-faf1-4b62-9d0f-d1c3b198f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.135310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b6fa-faf1-4b62-9d0f-d1c3b198f9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.135599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b6fa-faf1-4b62-9d0f-d1c3b198f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.135883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b6fa-faf1-4b62-9d0f-d1c3b198f9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.136625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b6fa-faf1-4b62-9d0f-d1c3b198f9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.138781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b6fa-faf1-4b62-9d0f-d1c3b198f9c9 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.141642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a25de-a1c5-4376-8991-fcde0ec5f065 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.146589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23207d-0af7-47b2-86fd-95473dca6d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.147301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23207d-0af7-47b2-86fd-95473dca6d1b admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.147706 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23207d-0af7-47b2-86fd-95473dca6d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.147864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23207d-0af7-47b2-86fd-95473dca6d1b admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.148591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23207d-0af7-47b2-86fd-95473dca6d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.150652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23207d-0af7-47b2-86fd-95473dca6d1b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.161466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 783/1587] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:15 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:15.162936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19049571-ddf0-4980-a428-e4d79a641065 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.163222 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19049571-ddf0-4980-a428-e4d79a641065 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.163497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19049571-ddf0-4980-a428-e4d79a641065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.178432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 805/1588] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:15 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:15.178789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23207d-0af7-47b2-86fd-95473dca6d1b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.194973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23207d-0af7-47b2-86fd-95473dca6d1b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.197625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-19049571-ddf0-4980-a428-e4d79a641065 None None] MFA Rules not processed for user `43b0bb5ce8824afea4ec10d2235be0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:15.198885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-19049571-ddf0-4980-a428-e4d79a641065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:15.200265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506f4c3-f550-4b44-b4ad-c3610c06029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.200954 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506f4c3-f550-4b44-b4ad-c3610c06029c admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.201232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506f4c3-f550-4b44-b4ad-c3610c06029c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.201508 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506f4c3-f550-4b44-b4ad-c3610c06029c admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.202235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506f4c3-f550-4b44-b4ad-c3610c06029c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.203873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506f4c3-f550-4b44-b4ad-c3610c06029c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.214152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 806/1589] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.215014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506f4c3-f550-4b44-b4ad-c3610c06029c admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.224833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506f4c3-f550-4b44-b4ad-c3610c06029c admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.229807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eca1ec-9c11-4a5d-8020-95796a9b34c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.231448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eca1ec-9c11-4a5d-8020-95796a9b34c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.231731 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eca1ec-9c11-4a5d-8020-95796a9b34c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.232009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eca1ec-9c11-4a5d-8020-95796a9b34c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.232733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eca1ec-9c11-4a5d-8020-95796a9b34c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.234336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eca1ec-9c11-4a5d-8020-95796a9b34c5 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.245620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 807/1590] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.247141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eca1ec-9c11-4a5d-8020-95796a9b34c5 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.250462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:15.257933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eca1ec-9c11-4a5d-8020-95796a9b34c5 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.264543 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc71ed4-ca39-4d86-9ad4-26acfb927f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.265936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc71ed4-ca39-4d86-9ad4-26acfb927f92 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.266273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc71ed4-ca39-4d86-9ad4-26acfb927f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.266621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc71ed4-ca39-4d86-9ad4-26acfb927f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.267366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc71ed4-ca39-4d86-9ad4-26acfb927f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.268982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc71ed4-ca39-4d86-9ad4-26acfb927f92 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.278179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 784/1591] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:15.279534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1436d2e-64fe-430c-8db5-a6b854660ff2 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.279819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1436d2e-64fe-430c-8db5-a6b854660ff2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.280118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1436d2e-64fe-430c-8db5-a6b854660ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.280289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 808/1592] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.280911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc71ed4-ca39-4d86-9ad4-26acfb927f92 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.297979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc71ed4-ca39-4d86-9ad4-26acfb927f92 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.303141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd636f-e435-4808-8282-e16a39b39bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.304066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd636f-e435-4808-8282-e16a39b39bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.305282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd636f-e435-4808-8282-e16a39b39bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.305282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd636f-e435-4808-8282-e16a39b39bd7 admin admin] PATH_INFO: `/v3/projects/3c25c3284c5c43a4b3063ef483e24dfb/users/d3b7491e67544485bc964386ed5946bd/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.323919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d1436d2e-64fe-430c-8db5-a6b854660ff2 None None] MFA Rules not processed for user `73bd01db605349b089fb01e0711b89ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:15.325784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d1436d2e-64fe-430c-8db5-a6b854660ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:15.325911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd636f-e435-4808-8282-e16a39b39bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c25c3284c5c43a4b3063ef483e24dfb, user_id=d3b7491e67544485bc964386ed5946bd, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.326963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING py.warnings [None req-b6fd636f-e435-4808-8282-e16a39b39bd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:50:15.326963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: warnings.warn(msg) Jun 16 18:50:15.326963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: Jun 16 18:50:15.329459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd636f-e435-4808-8282-e16a39b39bd7 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.349507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 809/1593] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:15 2022] PUT /identity/v3/projects/3c25c3284c5c43a4b3063ef483e24dfb/users/d3b7491e67544485bc964386ed5946bd/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:15.350348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd636f-e435-4808-8282-e16a39b39bd7 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.401494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:15.404360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 785/1594] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:15.405180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1436d2e-64fe-430c-8db5-a6b854660ff2 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.417568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1436d2e-64fe-430c-8db5-a6b854660ff2 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.422154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e477-2a5c-4ccf-a1f6-46e6b25a9a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.422619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd636f-e435-4808-8282-e16a39b39bd7 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.422858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e477-2a5c-4ccf-a1f6-46e6b25a9a9b admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.423140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e477-2a5c-4ccf-a1f6-46e6b25a9a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.423676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e477-2a5c-4ccf-a1f6-46e6b25a9a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.424402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e477-2a5c-4ccf-a1f6-46e6b25a9a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.426000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e477-2a5c-4ccf-a1f6-46e6b25a9a9b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.427706 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69196dc3-0f4f-4d6a-b11b-64e9542d91e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.428408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69196dc3-0f4f-4d6a-b11b-64e9542d91e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.428721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69196dc3-0f4f-4d6a-b11b-64e9542d91e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.429019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69196dc3-0f4f-4d6a-b11b-64e9542d91e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.429747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69196dc3-0f4f-4d6a-b11b-64e9542d91e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.431424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69196dc3-0f4f-4d6a-b11b-64e9542d91e5 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.437220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 786/1595] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.437824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e477-2a5c-4ccf-a1f6-46e6b25a9a9b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.442373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 810/1596] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.443447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69196dc3-0f4f-4d6a-b11b-64e9542d91e5 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.448432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e477-2a5c-4ccf-a1f6-46e6b25a9a9b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.454597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f321e-bfaa-4478-b218-42bc2ba87ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.455487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f321e-bfaa-4478-b218-42bc2ba87ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.455769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f321e-bfaa-4478-b218-42bc2ba87ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.456042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f321e-bfaa-4478-b218-42bc2ba87ca9 admin admin] PATH_INFO: `/v3/projects/5a4b6ef620e14095a29b907746decc8b/users/ccb309041aee42d49b2e9b992a6a87d1/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.456497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69196dc3-0f4f-4d6a-b11b-64e9542d91e5 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.461530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd0f48-f86e-4a5e-bf19-c404f99eef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.462194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd0f48-f86e-4a5e-bf19-c404f99eef79 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.462511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd0f48-f86e-4a5e-bf19-c404f99eef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.462784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd0f48-f86e-4a5e-bf19-c404f99eef79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.463502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd0f48-f86e-4a5e-bf19-c404f99eef79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.465138 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd0f48-f86e-4a5e-bf19-c404f99eef79 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.472261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f321e-bfaa-4478-b218-42bc2ba87ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4b6ef620e14095a29b907746decc8b, user_id=ccb309041aee42d49b2e9b992a6a87d1, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.475605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f321e-bfaa-4478-b218-42bc2ba87ca9 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.476792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 811/1597] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.477472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd0f48-f86e-4a5e-bf19-c404f99eef79 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.489684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd0f48-f86e-4a5e-bf19-c404f99eef79 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.490056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 787/1598] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:15 2022] PUT /identity/v3/projects/5a4b6ef620e14095a29b907746decc8b/users/ccb309041aee42d49b2e9b992a6a87d1/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:15.493917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce35348-d6a9-4c3c-88f2-8bcd325ace59 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.493917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce35348-d6a9-4c3c-88f2-8bcd325ace59 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.493917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce35348-d6a9-4c3c-88f2-8bcd325ace59 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.494202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 788/1599] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jun 16 18:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:15.495255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f59562-c075-4ac9-81fc-55f23061bb9e None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.495540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f59562-c075-4ac9-81fc-55f23061bb9e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.495820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f59562-c075-4ac9-81fc-55f23061bb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.516916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-b3f59562-c075-4ac9-81fc-55f23061bb9e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:15.518127 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b3f59562-c075-4ac9-81fc-55f23061bb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:15.561599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793325-e486-43a2-8135-fde18616b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.562272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793325-e486-43a2-8135-fde18616b3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.562580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793325-e486-43a2-8135-fde18616b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.562862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793325-e486-43a2-8135-fde18616b3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.563580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3793325-e486-43a2-8135-fde18616b3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.565266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3793325-e486-43a2-8135-fde18616b3b9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.575786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 812/1600] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.576597 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793325-e486-43a2-8135-fde18616b3b9 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.583177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 789/1601] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:15.584049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f59562-c075-4ac9-81fc-55f23061bb9e None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.587090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793325-e486-43a2-8135-fde18616b3b9 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.591893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773237-49c9-47e4-9fdc-95fcaf9f67d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.592565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773237-49c9-47e4-9fdc-95fcaf9f67d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.592848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773237-49c9-47e4-9fdc-95fcaf9f67d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.593122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773237-49c9-47e4-9fdc-95fcaf9f67d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.593813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17773237-49c9-47e4-9fdc-95fcaf9f67d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.595751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17773237-49c9-47e4-9fdc-95fcaf9f67d2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.596172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f59562-c075-4ac9-81fc-55f23061bb9e None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.600912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33756-6486-4eaf-8a41-533be6c44169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.601581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33756-6486-4eaf-8a41-533be6c44169 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.601863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33756-6486-4eaf-8a41-533be6c44169 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.602142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33756-6486-4eaf-8a41-533be6c44169 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.602917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d33756-6486-4eaf-8a41-533be6c44169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.604545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d33756-6486-4eaf-8a41-533be6c44169 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.615111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 790/1602] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.615958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33756-6486-4eaf-8a41-533be6c44169 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.625693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 813/1603] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:15 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:15.626530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773237-49c9-47e4-9fdc-95fcaf9f67d2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.633525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33756-6486-4eaf-8a41-533be6c44169 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.663978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:15.696419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773237-49c9-47e4-9fdc-95fcaf9f67d2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.701776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956909d2-afd1-430e-9f3b-893e190632a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.702715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956909d2-afd1-430e-9f3b-893e190632a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.702966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956909d2-afd1-430e-9f3b-893e190632a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.703225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956909d2-afd1-430e-9f3b-893e190632a0 admin admin] PATH_INFO: `/v3/projects/ebbf35a731034734b426712b9abe5bbc/users/aacb60b92e9346dda3f4e2c43885a883/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.709813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bb46e-a860-47ad-9441-bb4b6da94dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.710548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb46e-a860-47ad-9441-bb4b6da94dec admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.710834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb46e-a860-47ad-9441-bb4b6da94dec admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.711112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb46e-a860-47ad-9441-bb4b6da94dec admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.711846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bb46e-a860-47ad-9441-bb4b6da94dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.713467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bb46e-a860-47ad-9441-bb4b6da94dec admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.719510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956909d2-afd1-430e-9f3b-893e190632a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbf35a731034734b426712b9abe5bbc, user_id=aacb60b92e9346dda3f4e2c43885a883, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.722127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956909d2-afd1-430e-9f3b-893e190632a0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.723788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 791/1604] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:15.725159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd34591-afce-45f1-a684-9325e04a21aa None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.725450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd34591-afce-45f1-a684-9325e04a21aa None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.725731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd34591-afce-45f1-a684-9325e04a21aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.736569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 814/1605] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:15 2022] PUT /identity/v3/projects/ebbf35a731034734b426712b9abe5bbc/users/aacb60b92e9346dda3f4e2c43885a883/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:15.739861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147e256-fa7e-49a2-a82a-13f34ed34b8c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.740141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147e256-fa7e-49a2-a82a-13f34ed34b8c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.740422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147e256-fa7e-49a2-a82a-13f34ed34b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.745053 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-9cd34591-afce-45f1-a684-9325e04a21aa None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:15.746795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-9cd34591-afce-45f1-a684-9325e04a21aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:15.759284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-7147e256-fa7e-49a2-a82a-13f34ed34b8c None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:15.760419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7147e256-fa7e-49a2-a82a-13f34ed34b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:15.781229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:15.820332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 792/1606] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:15.821200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd34591-afce-45f1-a684-9325e04a21aa None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.831815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd34591-afce-45f1-a684-9325e04a21aa None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.834507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 815/1607] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jun 16 18:50:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:15.835422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147e256-fa7e-49a2-a82a-13f34ed34b8c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.836845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d56fe1-173b-40ba-9652-55e6fbac13e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.837742 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d56fe1-173b-40ba-9652-55e6fbac13e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.838025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d56fe1-173b-40ba-9652-55e6fbac13e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.838303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d56fe1-173b-40ba-9652-55e6fbac13e8 admin admin] PATH_INFO: `/v3/projects/ceb9c5afa0184f63b81bed1003e4e110/users/1102ea41868d4b87a1cd7090b773325a/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.855512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d56fe1-173b-40ba-9652-55e6fbac13e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb9c5afa0184f63b81bed1003e4e110, user_id=1102ea41868d4b87a1cd7090b773325a, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.858826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d56fe1-173b-40ba-9652-55e6fbac13e8 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.872777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 793/1608] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:15 2022] PUT /identity/v3/projects/ceb9c5afa0184f63b81bed1003e4e110/users/1102ea41868d4b87a1cd7090b773325a/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:15.873568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d56fe1-173b-40ba-9652-55e6fbac13e8 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.910289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147e256-fa7e-49a2-a82a-13f34ed34b8c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.942499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d56fe1-173b-40ba-9652-55e6fbac13e8 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:15.947660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea854ceb-a475-4d36-a0e3-6bb769e4a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.948758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea854ceb-a475-4d36-a0e3-6bb769e4a335 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.949253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea854ceb-a475-4d36-a0e3-6bb769e4a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.949590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea854ceb-a475-4d36-a0e3-6bb769e4a335 admin admin] PATH_INFO: `/v3/projects/ed7d6f19cd7d4ef4b221175972b8db78/users/c4dfdeb737d149d881bc9cbd9116cd6e/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.965363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e815fe-bea5-4654-af68-ecd080eca479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:15.965945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea854ceb-a475-4d36-a0e3-6bb769e4a335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7d6f19cd7d4ef4b221175972b8db78, user_id=c4dfdeb737d149d881bc9cbd9116cd6e, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.966172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e815fe-bea5-4654-af68-ecd080eca479 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:15.966352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e815fe-bea5-4654-af68-ecd080eca479 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:15.966579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e815fe-bea5-4654-af68-ecd080eca479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:15.968628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea854ceb-a475-4d36-a0e3-6bb769e4a335 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.978230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e815fe-bea5-4654-af68-ecd080eca479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:15.980061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e815fe-bea5-4654-af68-ecd080eca479 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:15.982850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 794/1609] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:15 2022] PUT /identity/v3/projects/ed7d6f19cd7d4ef4b221175972b8db78/users/c4dfdeb737d149d881bc9cbd9116cd6e/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:15.983654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea854ceb-a475-4d36-a0e3-6bb769e4a335 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:15.994078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 816/1610] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:15.994936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e815fe-bea5-4654-af68-ecd080eca479 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:16.005115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e815fe-bea5-4654-af68-ecd080eca479 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.027077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:16.078629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea854ceb-a475-4d36-a0e3-6bb769e4a335 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.080678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb32dd3-a6e8-4d51-a49c-425b3c6b49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:16.081799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32dd3-a6e8-4d51-a49c-425b3c6b49ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.082144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32dd3-a6e8-4d51-a49c-425b3c6b49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.082479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb32dd3-a6e8-4d51-a49c-425b3c6b49ba admin admin] PATH_INFO: `/v3/projects/cf5941c4e8fb47aa82c0abe988f2b722/users/b1db987d3ae24618b5ea92ff0f265fdd/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.085078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845297fe-7fed-498d-93ae-2fc17a35f2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:16.086159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845297fe-7fed-498d-93ae-2fc17a35f2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.086477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845297fe-7fed-498d-93ae-2fc17a35f2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.086752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845297fe-7fed-498d-93ae-2fc17a35f2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.087712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845297fe-7fed-498d-93ae-2fc17a35f2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:16.089849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845297fe-7fed-498d-93ae-2fc17a35f2c0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:16.104514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb32dd3-a6e8-4d51-a49c-425b3c6b49ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5941c4e8fb47aa82c0abe988f2b722, user_id=b1db987d3ae24618b5ea92ff0f265fdd, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:16.107904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb32dd3-a6e8-4d51-a49c-425b3c6b49ba admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:16.115147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 795/1611] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:15 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:16.116729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c578e-bc8a-4702-bffb-b6378b91dc74 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.117050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c578e-bc8a-4702-bffb-b6378b91dc74 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.117294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c578e-bc8a-4702-bffb-b6378b91dc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.118862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:16.130183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 817/1612] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:15 2022] PUT /identity/v3/projects/cf5941c4e8fb47aa82c0abe988f2b722/users/b1db987d3ae24618b5ea92ff0f265fdd/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:16.130681 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb32dd3-a6e8-4d51-a49c-425b3c6b49ba admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:16.143814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-0d6c578e-bc8a-4702-bffb-b6378b91dc74 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:16.145176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0d6c578e-bc8a-4702-bffb-b6378b91dc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:16.215785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb32dd3-a6e8-4d51-a49c-425b3c6b49ba admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.220892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a12889-64d4-4d35-a0c4-eed87cc8561a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:16.221612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a12889-64d4-4d35-a0c4-eed87cc8561a service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.222127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a12889-64d4-4d35-a0c4-eed87cc8561a service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.222228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a12889-64d4-4d35-a0c4-eed87cc8561a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.236532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 796/1613] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:16.237641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c578e-bc8a-4702-bffb-b6378b91dc74 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:16.249558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a12889-64d4-4d35-a0c4-eed87cc8561a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:16.251060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a12889-64d4-4d35-a0c4-eed87cc8561a service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:16.266171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 818/1614] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:16.268590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99b16-9206-4573-9d5c-96c55417a497 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.268865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99b16-9206-4573-9d5c-96c55417a497 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.269448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99b16-9206-4573-9d5c-96c55417a497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.308498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d1c99b16-9206-4573-9d5c-96c55417a497 None None] MFA Rules not processed for user `1102ea41868d4b87a1cd7090b773325a`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:16.310290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d1c99b16-9206-4573-9d5c-96c55417a497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:16.349572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c578e-bc8a-4702-bffb-b6378b91dc74 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.357331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee298b4-3067-4442-91f8-905c67f5bac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:16.358303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee298b4-3067-4442-91f8-905c67f5bac1 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.358734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee298b4-3067-4442-91f8-905c67f5bac1 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.359109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee298b4-3067-4442-91f8-905c67f5bac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.431365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:16.435876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee298b4-3067-4442-91f8-905c67f5bac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:16.439284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee298b4-3067-4442-91f8-905c67f5bac1 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:16.450845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 797/1615] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:16.452448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee800-a74f-4d3f-ae9f-71da253f6123 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.452745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee800-a74f-4d3f-ae9f-71da253f6123 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.453024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee800-a74f-4d3f-ae9f-71da253f6123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.475658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-289ee800-a74f-4d3f-ae9f-71da253f6123 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:16.476902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-289ee800-a74f-4d3f-ae9f-71da253f6123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:16.487124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 798/1616] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:16.497838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ee800-a74f-4d3f-ae9f-71da253f6123 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:16.513365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ee800-a74f-4d3f-ae9f-71da253f6123 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.520185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aff449-049a-446d-9379-eae5a9a106a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:16.520981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff449-049a-446d-9379-eae5a9a106a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.521281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff449-049a-446d-9379-eae5a9a106a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.521556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff449-049a-446d-9379-eae5a9a106a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.522300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aff449-049a-446d-9379-eae5a9a106a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:16.524512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aff449-049a-446d-9379-eae5a9a106a4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:16.541985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 799/1617] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:16.544669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288173-d6fe-45e2-bbea-791f866c27c7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.544825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288173-d6fe-45e2-bbea-791f866c27c7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.545184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288173-d6fe-45e2-bbea-791f866c27c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.600474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 819/1618] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:16.600474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99b16-9206-4573-9d5c-96c55417a497 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:16.615193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-64288173-d6fe-45e2-bbea-791f866c27c7 None None] MFA Rules not processed for user `b1db987d3ae24618b5ea92ff0f265fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:16.617857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-64288173-d6fe-45e2-bbea-791f866c27c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:16.620391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99b16-9206-4573-9d5c-96c55417a497 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.630697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deea47-5331-41ca-85c7-772d061e5ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:16.634002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deea47-5331-41ca-85c7-772d061e5ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.635159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deea47-5331-41ca-85c7-772d061e5ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.635632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deea47-5331-41ca-85c7-772d061e5ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.682751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5deea47-5331-41ca-85c7-772d061e5ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:16.689060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5deea47-5331-41ca-85c7-772d061e5ef9 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:16.729600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 820/1619] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:16.733262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deea47-5331-41ca-85c7-772d061e5ef9 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:16.749024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deea47-5331-41ca-85c7-772d061e5ef9 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.763513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b1c83-8d0b-4836-bc25-ea385243cf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:16.764993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b1c83-8d0b-4836-bc25-ea385243cf1b service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.765194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b1c83-8d0b-4836-bc25-ea385243cf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.766827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b1c83-8d0b-4836-bc25-ea385243cf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.787440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b1c83-8d0b-4836-bc25-ea385243cf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:16.790186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b1c83-8d0b-4836-bc25-ea385243cf1b service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:16.816490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 821/1620] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:16.817575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b1c83-8d0b-4836-bc25-ea385243cf1b service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:16.827614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 800/1621] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:16.830811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a589e-edb4-4081-bc3c-341f0d92fb5d None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.831164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a589e-edb4-4081-bc3c-341f0d92fb5d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.831450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a589e-edb4-4081-bc3c-341f0d92fb5d None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.833103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 801/1622] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jun 16 18:50:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:16.833414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b1c83-8d0b-4836-bc25-ea385243cf1b service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.841019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f7625-8286-4fbe-85a4-d335c42c0c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:16.841688 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b353e0-a43b-40c9-a4da-447df08f0ec3 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.841987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b353e0-a43b-40c9-a4da-447df08f0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.842269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b353e0-a43b-40c9-a4da-447df08f0ec3 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.842368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7625-8286-4fbe-85a4-d335c42c0c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.842780 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7625-8286-4fbe-85a4-d335c42c0c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.843158 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7625-8286-4fbe-85a4-d335c42c0c5a admin admin] PATH_INFO: `/v3/projects/8efbd4ab95a948388f74636a616a5eca/users/a586ad7670bd4ba38d53c26da98245f1/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.850838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 802/1623] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jun 16 18:50:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:16.850838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b353e0-a43b-40c9-a4da-447df08f0ec3 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:16.866927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f7625-8286-4fbe-85a4-d335c42c0c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efbd4ab95a948388f74636a616a5eca, user_id=a586ad7670bd4ba38d53c26da98245f1, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:16.869713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f7625-8286-4fbe-85a4-d335c42c0c5a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:16.886505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 822/1624] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:16 2022] PUT /identity/v3/projects/8efbd4ab95a948388f74636a616a5eca/users/a586ad7670bd4ba38d53c26da98245f1/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:16.888914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ace964-3a9c-4b4d-9ded-3fa04b2d907c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:16.889304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ace964-3a9c-4b4d-9ded-3fa04b2d907c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:16.889806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ace964-3a9c-4b4d-9ded-3fa04b2d907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:16.937859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b353e0-a43b-40c9-a4da-447df08f0ec3 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:16.954438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-82ace964-3a9c-4b4d-9ded-3fa04b2d907c None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:16.957174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-82ace964-3a9c-4b4d-9ded-3fa04b2d907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:17.017554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660fca4-67eb-4192-b797-63827855d9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:17.018226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660fca4-67eb-4192-b797-63827855d9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.018544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660fca4-67eb-4192-b797-63827855d9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.018824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660fca4-67eb-4192-b797-63827855d9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.056770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:17.093638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:17.130807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660fca4-67eb-4192-b797-63827855d9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:17.132779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660fca4-67eb-4192-b797-63827855d9b3 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:17.134035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 823/1625] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jun 16 18:50:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:17.135569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c59de8-809b-4406-a215-138dd3e06087 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.135862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c59de8-809b-4406-a215-138dd3e06087 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.136146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c59de8-809b-4406-a215-138dd3e06087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.149939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 803/1626] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:17.151948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660fca4-67eb-4192-b797-63827855d9b3 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:17.158649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-f4c59de8-809b-4406-a215-138dd3e06087 None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:17.160604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f4c59de8-809b-4406-a215-138dd3e06087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:17.178907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 824/1627] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:50:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:17.180072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c59de8-809b-4406-a215-138dd3e06087 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:17.194295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c59de8-809b-4406-a215-138dd3e06087 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:17.203048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a3dda-5797-46b1-a947-93bf3870c422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:17.203725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3dda-5797-46b1-a947-93bf3870c422 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.204014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3dda-5797-46b1-a947-93bf3870c422 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.204785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3dda-5797-46b1-a947-93bf3870c422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.281346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660fca4-67eb-4192-b797-63827855d9b3 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:17.294261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349acdd-e23b-4045-973e-1ae6298e53df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:17.295012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349acdd-e23b-4045-973e-1ae6298e53df admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.295300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349acdd-e23b-4045-973e-1ae6298e53df admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.295581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349acdd-e23b-4045-973e-1ae6298e53df admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.296329 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349acdd-e23b-4045-973e-1ae6298e53df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:17.297954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349acdd-e23b-4045-973e-1ae6298e53df admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:17.315105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 804/1628] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:17.316068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349acdd-e23b-4045-973e-1ae6298e53df admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:17.327288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349acdd-e23b-4045-973e-1ae6298e53df admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:17.332790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9077e-d336-4f27-ae9e-248854beab3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:17.333175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9077e-d336-4f27-ae9e-248854beab3e service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.333470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9077e-d336-4f27-ae9e-248854beab3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.333745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9077e-d336-4f27-ae9e-248854beab3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.341881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a3dda-5797-46b1-a947-93bf3870c422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:17.347091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a3dda-5797-46b1-a947-93bf3870c422 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:17.358992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9077e-d336-4f27-ae9e-248854beab3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:17.361235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9077e-d336-4f27-ae9e-248854beab3e service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:17.384626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 825/1629] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:17.385504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a3dda-5797-46b1-a947-93bf3870c422 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:17.408311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 805/1630] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:17.421553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a3dda-5797-46b1-a947-93bf3870c422 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:17.445740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37b33-4f7d-44fa-90e1-b8b6ea7dc6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:17.446883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37b33-4f7d-44fa-90e1-b8b6ea7dc6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.447173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37b33-4f7d-44fa-90e1-b8b6ea7dc6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.447448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37b33-4f7d-44fa-90e1-b8b6ea7dc6b9 admin admin] PATH_INFO: `/v3/projects/8efbd4ab95a948388f74636a616a5eca/users/a586ad7670bd4ba38d53c26da98245f1/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.455948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c37b33-4f7d-44fa-90e1-b8b6ea7dc6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efbd4ab95a948388f74636a616a5eca, user_id=a586ad7670bd4ba38d53c26da98245f1, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:17.460700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c37b33-4f7d-44fa-90e1-b8b6ea7dc6b9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:17.500347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 826/1631] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:17 2022] PUT /identity/v3/projects/8efbd4ab95a948388f74636a616a5eca/users/a586ad7670bd4ba38d53c26da98245f1/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:17.501479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f4eb-1610-47c7-9ccf-5b286e5f2734 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:17.501959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f4eb-1610-47c7-9ccf-5b286e5f2734 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:17.502107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f4eb-1610-47c7-9ccf-5b286e5f2734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:17.566342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-3837f4eb-1610-47c7-9ccf-5b286e5f2734 None None] MFA Rules not processed for user `a586ad7670bd4ba38d53c26da98245f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:17.569947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-3837f4eb-1610-47c7-9ccf-5b286e5f2734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:17.778883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 806/1632] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:18.061745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d203-5d26-41a9-9e4f-75cc31efd4cd None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:18.062794 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d203-5d26-41a9-9e4f-75cc31efd4cd None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:18.063232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0d203-5d26-41a9-9e4f-75cc31efd4cd None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:18.065390 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 827/1633] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jun 16 18:50:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:18.075134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c3221-365b-45af-9bad-c9011bccc7d5 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:18.076389 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c3221-365b-45af-9bad-c9011bccc7d5 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:18.076832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c3221-365b-45af-9bad-c9011bccc7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:18.102245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c32c3221-365b-45af-9bad-c9011bccc7d5 None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:18.103952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c32c3221-365b-45af-9bad-c9011bccc7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:18.175435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:18.233784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 807/1634] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:50:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:18.319821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0d203-5d26-41a9-9e4f-75cc31efd4cd None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:18.456982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0d203-5d26-41a9-9e4f-75cc31efd4cd None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:18.460889 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04790a-15c9-43e8-af8e-958645d6afb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:18.461579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04790a-15c9-43e8-af8e-958645d6afb9 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:18.461864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04790a-15c9-43e8-af8e-958645d6afb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:18.462142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04790a-15c9-43e8-af8e-958645d6afb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:18.484358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04790a-15c9-43e8-af8e-958645d6afb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:18.488808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04790a-15c9-43e8-af8e-958645d6afb9 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:18.521235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 828/1635] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:18.600232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c3221-365b-45af-9bad-c9011bccc7d5 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:18.616554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c3221-365b-45af-9bad-c9011bccc7d5 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:18.624682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799f128-38e4-487c-9a7a-8850c44e4083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:18.625476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799f128-38e4-487c-9a7a-8850c44e4083 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:18.625765 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799f128-38e4-487c-9a7a-8850c44e4083 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:18.626046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799f128-38e4-487c-9a7a-8850c44e4083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:18.666867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799f128-38e4-487c-9a7a-8850c44e4083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:18.673100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799f128-38e4-487c-9a7a-8850c44e4083 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:18.701065 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 808/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:19.104107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04790a-15c9-43e8-af8e-958645d6afb9 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:19.154407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799f128-38e4-487c-9a7a-8850c44e4083 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:19.165596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799f128-38e4-487c-9a7a-8850c44e4083 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:19.170351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058719fc-7626-40ff-a231-a78fe7c7f3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:19.171719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058719fc-7626-40ff-a231-a78fe7c7f3ce service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:19.172110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058719fc-7626-40ff-a231-a78fe7c7f3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:19.172465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058719fc-7626-40ff-a231-a78fe7c7f3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:19.232038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:19.256114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04790a-15c9-43e8-af8e-958645d6afb9 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:19.266497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:19.267401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:19.269436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:19.269917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] PATH_INFO: `/v3/users/1102ea41868d4b87a1cd7090b773325a` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:19.273356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1102ea41868d4b87a1cd7090b773325a)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:19.274463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058719fc-7626-40ff-a231-a78fe7c7f3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:19.276966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058719fc-7626-40ff-a231-a78fe7c7f3ce service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:19.277095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: WARNING py.warnings [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:50:19.277095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: warnings.warn(msg) Jun 16 18:50:19.277095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: Jun 16 18:50:19.281809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:19.311900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 809/1637] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:19.427635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1102ea41868d4b87a1cd7090b773325a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:19.470800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1102ea41868d4b87a1cd7090b773325a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:19.471603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1102ea41868d4b87a1cd7090b773325a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:19.495686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1102ea41868d4b87a1cd7090b773325a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:19.513241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1102ea41868d4b87a1cd7090b773325a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:19.521346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 829/1638] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:50:19 2022] DELETE /identity/v3/users/1102ea41868d4b87a1cd7090b773325a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:19.525863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4410b-d70a-42c5-add0-adc802ee005a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:19.526142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4410b-d70a-42c5-add0-adc802ee005a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:19.526443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4410b-d70a-42c5-add0-adc802ee005a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:19.557570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-54a4410b-d70a-42c5-add0-adc802ee005a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:19.559557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-54a4410b-d70a-42c5-add0-adc802ee005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:19.707868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 810/1639] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:19.732752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:19.734264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:19.918518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff863322-789b-4bf1-aa38-710713e1ffb0 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:19.929583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ca06-4d57-4efa-a1ca-a3c17fcd6744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:19.930202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ca06-4d57-4efa-a1ca-a3c17fcd6744 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:19.930547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ca06-4d57-4efa-a1ca-a3c17fcd6744 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:19.930807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ca06-4d57-4efa-a1ca-a3c17fcd6744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:19.953288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922ca06-4d57-4efa-a1ca-a3c17fcd6744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:19.954776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922ca06-4d57-4efa-a1ca-a3c17fcd6744 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:19.979426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 830/1640] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:22.478272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4410b-d70a-42c5-add0-adc802ee005a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:22.479938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-54a4410b-d70a-42c5-add0-adc802ee005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:22.532715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4410b-d70a-42c5-add0-adc802ee005a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:22.553653 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:22.559419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:22.559993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:22.561240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] PATH_INFO: `/v3/projects/ceb9c5afa0184f63b81bed1003e4e110` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:22.568950 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb9c5afa0184f63b81bed1003e4e110)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:22.572210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: WARNING py.warnings [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:50:22.572210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: warnings.warn(msg) Jun 16 18:50:22.572210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: Jun 16 18:50:22.576121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:22.751391 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb9c5afa0184f63b81bed1003e4e110', 'request_id': 'req-981ab297-59df-4c72-a513-0a67cbb9a13d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:22.772737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb9c5afa0184f63b81bed1003e4e110', 'request_id': 'req-981ab297-59df-4c72-a513-0a67cbb9a13d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:22.774468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:22.829163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb9c5afa0184f63b81bed1003e4e110', 'request_id': 'req-981ab297-59df-4c72-a513-0a67cbb9a13d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:22.867793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] The token cache is being invalidate because project ceb9c5afa0184f63b81bed1003e4e110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:50:22.868144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:22.868787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-981ab297-59df-4c72-a513-0a67cbb9a13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:22.871882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 811/1641] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:50:22 2022] DELETE /identity/v3/projects/ceb9c5afa0184f63b81bed1003e4e110 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:22.876689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cbae3-a644-4794-a6dc-745e01b33f03 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:22.877652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cbae3-a644-4794-a6dc-745e01b33f03 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:22.878159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cbae3-a644-4794-a6dc-745e01b33f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:22.949150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-686cbae3-a644-4794-a6dc-745e01b33f03 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:22.952610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-686cbae3-a644-4794-a6dc-745e01b33f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:23.246520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 831/1642] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:23.255022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc4333-0a46-48f0-9d12-658b1eb3e359 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:23.255263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc4333-0a46-48f0-9d12-658b1eb3e359 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:23.255547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc4333-0a46-48f0-9d12-658b1eb3e359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:23.327702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-77bc4333-0a46-48f0-9d12-658b1eb3e359 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:23.339645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-77bc4333-0a46-48f0-9d12-658b1eb3e359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:23.372386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 812/1643] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:23.378299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cbae3-a644-4794-a6dc-745e01b33f03 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:23.414149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cbae3-a644-4794-a6dc-745e01b33f03 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:23.447811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ac0de-ed7a-4726-9d82-c280945cf2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:23.448907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ac0de-ed7a-4726-9d82-c280945cf2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:23.451964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ac0de-ed7a-4726-9d82-c280945cf2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:23.457814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ac0de-ed7a-4726-9d82-c280945cf2d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:23.459285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ac0de-ed7a-4726-9d82-c280945cf2d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:23.467500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ac0de-ed7a-4726-9d82-c280945cf2d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:23.476239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ac0de-ed7a-4726-9d82-c280945cf2d0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:23.532921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 832/1644] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:50:23.534237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc4333-0a46-48f0-9d12-658b1eb3e359 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:23.547020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc4333-0a46-48f0-9d12-658b1eb3e359 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:23.579447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f4ca-8e40-464c-a29f-ed83817ff3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:23.580376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f4ca-8e40-464c-a29f-ed83817ff3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:23.580769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f4ca-8e40-464c-a29f-ed83817ff3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:23.583096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8f4ca-8e40-464c-a29f-ed83817ff3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:23.585543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f4ca-8e40-464c-a29f-ed83817ff3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:23.599816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8f4ca-8e40-464c-a29f-ed83817ff3c0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:23.674268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 813/1645] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:23 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:23.675647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ac0de-ed7a-4726-9d82-c280945cf2d0 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:23.693663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:23.713530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ac0de-ed7a-4726-9d82-c280945cf2d0 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:23.925565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03640ca6-a924-4e22-921a-896cd7252a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:23.926441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03640ca6-a924-4e22-921a-896cd7252a21 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:23.926835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03640ca6-a924-4e22-921a-896cd7252a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:23.927254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03640ca6-a924-4e22-921a-896cd7252a21 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:23.928207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03640ca6-a924-4e22-921a-896cd7252a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:23.934255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03640ca6-a924-4e22-921a-896cd7252a21 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:23.979773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 833/1646] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:23 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:23.984319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f4ca-8e40-464c-a29f-ed83817ff3c0 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:24.005235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8f4ca-8e40-464c-a29f-ed83817ff3c0 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:24.017553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa893-d51c-4552-a6e4-7f8885bd3ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:24.017553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa893-d51c-4552-a6e4-7f8885bd3ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:24.017553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa893-d51c-4552-a6e4-7f8885bd3ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:24.017553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fa893-d51c-4552-a6e4-7f8885bd3ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:24.017851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fa893-d51c-4552-a6e4-7f8885bd3ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:24.019293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fa893-d51c-4552-a6e4-7f8885bd3ec2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:24.053747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03640ca6-a924-4e22-921a-896cd7252a21 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:24.064847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03640ca6-a924-4e22-921a-896cd7252a21 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:24.067739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 814/1647] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:24.088519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1ac8c-084f-40ab-a3eb-c042df5b7f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:24.089491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ac8c-084f-40ab-a3eb-c042df5b7f65 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:24.089975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ac8c-084f-40ab-a3eb-c042df5b7f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:24.090423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ac8c-084f-40ab-a3eb-c042df5b7f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:24.091317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1ac8c-084f-40ab-a3eb-c042df5b7f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:24.093169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1ac8c-084f-40ab-a3eb-c042df5b7f65 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:24.133232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 834/1648] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:24.137661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa893-d51c-4552-a6e4-7f8885bd3ec2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:24.170419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fa893-d51c-4552-a6e4-7f8885bd3ec2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:24.188894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2695e24-3f83-45a2-9685-6c43dc61ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:24.190277 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2695e24-3f83-45a2-9685-6c43dc61ab7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:24.191807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2695e24-3f83-45a2-9685-6c43dc61ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:24.192544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2695e24-3f83-45a2-9685-6c43dc61ab7e admin admin] PATH_INFO: `/v3/projects/68d7a751910d4b05ab48e83cafab8289/users/1c95f71f0c6742649721b15e60cdc45c/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:24.250928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2695e24-3f83-45a2-9685-6c43dc61ab7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d7a751910d4b05ab48e83cafab8289, user_id=1c95f71f0c6742649721b15e60cdc45c, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:24.253789 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2695e24-3f83-45a2-9685-6c43dc61ab7e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:24.305238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 815/1649] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:24 2022] PUT /identity/v3/projects/68d7a751910d4b05ab48e83cafab8289/users/1c95f71f0c6742649721b15e60cdc45c/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:24.317867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae1246-d6d5-4744-8d8b-2202ac938125 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:24.318795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae1246-d6d5-4744-8d8b-2202ac938125 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:24.319376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae1246-d6d5-4744-8d8b-2202ac938125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:24.409747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-15ae1246-d6d5-4744-8d8b-2202ac938125 None None] MFA Rules not processed for user `1c95f71f0c6742649721b15e60cdc45c`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:24.411780 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-15ae1246-d6d5-4744-8d8b-2202ac938125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:24.700808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 835/1650] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:24.706447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2695e24-3f83-45a2-9685-6c43dc61ab7e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:24.908791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2695e24-3f83-45a2-9685-6c43dc61ab7e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:24.940881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33926a2-03b4-4f1a-8071-b2e81abbd31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:24.941587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33926a2-03b4-4f1a-8071-b2e81abbd31b admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:24.941873 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33926a2-03b4-4f1a-8071-b2e81abbd31b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:24.942141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33926a2-03b4-4f1a-8071-b2e81abbd31b admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:24.946749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33926a2-03b4-4f1a-8071-b2e81abbd31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:24.959386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33926a2-03b4-4f1a-8071-b2e81abbd31b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:25.065550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 816/1651] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:24 2022] POST /identity/v3/projects => generated 379 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:25.070867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae1246-d6d5-4744-8d8b-2202ac938125 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:25.088889 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae1246-d6d5-4744-8d8b-2202ac938125 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:25.348821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb3f6-55a9-44b5-bc00-54450bd72134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:25.349521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb3f6-55a9-44b5-bc00-54450bd72134 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:25.349805 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb3f6-55a9-44b5-bc00-54450bd72134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:25.350091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eb3f6-55a9-44b5-bc00-54450bd72134 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:25.358217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eb3f6-55a9-44b5-bc00-54450bd72134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:25.360243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8eb3f6-55a9-44b5-bc00-54450bd72134 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:25.494064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:25.554064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33926a2-03b4-4f1a-8071-b2e81abbd31b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:25.567011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 836/1652] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:25 2022] POST /identity/v3/users => generated 296 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:50:25.599255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33926a2-03b4-4f1a-8071-b2e81abbd31b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:25.630821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c8b79-0338-4dc6-b532-ac6006d2a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:25.631672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c8b79-0338-4dc6-b532-ac6006d2a47e admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:25.632480 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c8b79-0338-4dc6-b532-ac6006d2a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:25.632886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c8b79-0338-4dc6-b532-ac6006d2a47e admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:25.633845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c8b79-0338-4dc6-b532-ac6006d2a47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:25.636386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c8b79-0338-4dc6-b532-ac6006d2a47e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:25.692384 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 817/1653] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:25.697921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb3f6-55a9-44b5-bc00-54450bd72134 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:25.753102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eb3f6-55a9-44b5-bc00-54450bd72134 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:25.782465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221098a3-1fae-4464-94f3-5dd67a5b5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:25.786663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221098a3-1fae-4464-94f3-5dd67a5b5be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:25.788780 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221098a3-1fae-4464-94f3-5dd67a5b5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:25.796208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221098a3-1fae-4464-94f3-5dd67a5b5be1 admin admin] PATH_INFO: `/v3/projects/7732758bacc24c6088abfd3bc25ece4f/users/24998eebf0a241678b38da20c7eeaf4e/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:25.922670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221098a3-1fae-4464-94f3-5dd67a5b5be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7732758bacc24c6088abfd3bc25ece4f, user_id=24998eebf0a241678b38da20c7eeaf4e, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:25.933258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221098a3-1fae-4464-94f3-5dd67a5b5be1 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:26.014268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c8b79-0338-4dc6-b532-ac6006d2a47e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:26.019195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 837/1654] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:25 2022] PUT /identity/v3/projects/7732758bacc24c6088abfd3bc25ece4f/users/24998eebf0a241678b38da20c7eeaf4e/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:26.020725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-bc6c8b79-0338-4dc6-b532-ac6006d2a47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:26.025089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221098a3-1fae-4464-94f3-5dd67a5b5be1 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:26.035292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c8b79-0338-4dc6-b532-ac6006d2a47e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:26.140618 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:26.165827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:26.169395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:26.170172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:26.171098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] PATH_INFO: `/v3/users/43b0bb5ce8824afea4ec10d2235be0c4` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:26.176473 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b0bb5ce8824afea4ec10d2235be0c4)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:26.179555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:26.297988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221098a3-1fae-4464-94f3-5dd67a5b5be1 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:26.304276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216669-9c1f-4d8e-af4a-0566188f8f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:26.309696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216669-9c1f-4d8e-af4a-0566188f8f06 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:26.310232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216669-9c1f-4d8e-af4a-0566188f8f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:26.310790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1216669-9c1f-4d8e-af4a-0566188f8f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:26.312502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216669-9c1f-4d8e-af4a-0566188f8f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:26.315973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1216669-9c1f-4d8e-af4a-0566188f8f06 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:26.318511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b0bb5ce8824afea4ec10d2235be0c4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:26.340548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b0bb5ce8824afea4ec10d2235be0c4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:26.341456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b0bb5ce8824afea4ec10d2235be0c4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:26.346672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 838/1655] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:26.357087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216669-9c1f-4d8e-af4a-0566188f8f06 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:26.361636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a1216669-9c1f-4d8e-af4a-0566188f8f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:26.363479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b0bb5ce8824afea4ec10d2235be0c4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:26.411210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4f2b93a-8624-4d82-95cd-d527e4b490f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b0bb5ce8824afea4ec10d2235be0c4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:26.450684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 818/1656] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:50:26 2022] DELETE /identity/v3/users/43b0bb5ce8824afea4ec10d2235be0c4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:26.455095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0a620-2921-4e0e-8bfa-3a8254cd1754 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:26.455755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1216669-9c1f-4d8e-af4a-0566188f8f06 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:26.456133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0a620-2921-4e0e-8bfa-3a8254cd1754 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:26.457935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0a620-2921-4e0e-8bfa-3a8254cd1754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:26.547057 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-58d0a620-2921-4e0e-8bfa-3a8254cd1754 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:26.550960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-58d0a620-2921-4e0e-8bfa-3a8254cd1754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:26.616796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5cae3-e0eb-4e02-a4b1-0214c4bfdf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:26.619154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5cae3-e0eb-4e02-a4b1-0214c4bfdf2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:26.619410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5cae3-e0eb-4e02-a4b1-0214c4bfdf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:26.619709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5cae3-e0eb-4e02-a4b1-0214c4bfdf2d admin admin] PATH_INFO: `/v3/projects/7732758bacc24c6088abfd3bc25ece4f/users/24998eebf0a241678b38da20c7eeaf4e/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:26.629235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5cae3-e0eb-4e02-a4b1-0214c4bfdf2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7732758bacc24c6088abfd3bc25ece4f, user_id=24998eebf0a241678b38da20c7eeaf4e, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:26.632736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5cae3-e0eb-4e02-a4b1-0214c4bfdf2d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:26.676232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 839/1657] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:26 2022] PUT /identity/v3/projects/7732758bacc24c6088abfd3bc25ece4f/users/24998eebf0a241678b38da20c7eeaf4e/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:26.687918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65878e-7f49-4336-9ebf-6871fd44e7fa None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:26.688210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65878e-7f49-4336-9ebf-6871fd44e7fa None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:26.688539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65878e-7f49-4336-9ebf-6871fd44e7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:26.765195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 819/1658] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:26.807485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-0c65878e-7f49-4336-9ebf-6871fd44e7fa None None] MFA Rules not processed for user `24998eebf0a241678b38da20c7eeaf4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:26.809035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0c65878e-7f49-4336-9ebf-6871fd44e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:26.882012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0a620-2921-4e0e-8bfa-3a8254cd1754 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:26.883649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-58d0a620-2921-4e0e-8bfa-3a8254cd1754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:27.004549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:27.065076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 840/1659] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:27.067995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0a620-2921-4e0e-8bfa-3a8254cd1754 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:27.171018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65878e-7f49-4336-9ebf-6871fd44e7fa None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:27.172833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0c65878e-7f49-4336-9ebf-6871fd44e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:27.196012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:27.275116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdd020-d4b2-4208-ae5e-6e024bcafca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:27.278260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd020-d4b2-4208-ae5e-6e024bcafca5 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:27.278578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd020-d4b2-4208-ae5e-6e024bcafca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:27.279355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd020-d4b2-4208-ae5e-6e024bcafca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:27.383420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65878e-7f49-4336-9ebf-6871fd44e7fa None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:27.398478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cf945-775c-443a-82a4-af844a99a16a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:27.399173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cf945-775c-443a-82a4-af844a99a16a service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:27.399455 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cf945-775c-443a-82a4-af844a99a16a service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:27.399729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cf945-775c-443a-82a4-af844a99a16a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:27.443560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cf945-775c-443a-82a4-af844a99a16a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:27.445046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cf945-775c-443a-82a4-af844a99a16a service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:27.510875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 841/1660] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:50:27.550264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdd020-d4b2-4208-ae5e-6e024bcafca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:27.552217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdd020-d4b2-4208-ae5e-6e024bcafca5 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:27.578973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 820/1661] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:27.709582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cf945-775c-443a-82a4-af844a99a16a service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:27.725246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cf945-775c-443a-82a4-af844a99a16a service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:27.734605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693051d8-92ef-4896-96bc-91a326201b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:27.735557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693051d8-92ef-4896-96bc-91a326201b22 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:27.736016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693051d8-92ef-4896-96bc-91a326201b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:27.736398 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693051d8-92ef-4896-96bc-91a326201b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:27.739036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-693051d8-92ef-4896-96bc-91a326201b22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:27.907043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693051d8-92ef-4896-96bc-91a326201b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:27.909870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693051d8-92ef-4896-96bc-91a326201b22 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:27.953518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 842/1662] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:29.413294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d498bb-3c66-4a46-aa73-22665a7c7d5c None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:29.413891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d498bb-3c66-4a46-aa73-22665a7c7d5c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:29.413891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d498bb-3c66-4a46-aa73-22665a7c7d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:29.489830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a7d498bb-3c66-4a46-aa73-22665a7c7d5c None None] MFA Rules not processed for user `ccb309041aee42d49b2e9b992a6a87d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:29.495449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a7d498bb-3c66-4a46-aa73-22665a7c7d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:29.736943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 821/1663] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:29.751638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9695d2-7343-4539-a2f6-baf661cc4e75 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:29.752104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9695d2-7343-4539-a2f6-baf661cc4e75 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:29.752186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9695d2-7343-4539-a2f6-baf661cc4e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:29.788664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1d9695d2-7343-4539-a2f6-baf661cc4e75 None None] MFA Rules not processed for user `ccb309041aee42d49b2e9b992a6a87d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:29.789928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1d9695d2-7343-4539-a2f6-baf661cc4e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:29.811410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 843/1664] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:29.837093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d498bb-3c66-4a46-aa73-22665a7c7d5c None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:29.838301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a7d498bb-3c66-4a46-aa73-22665a7c7d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:30.181025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d498bb-3c66-4a46-aa73-22665a7c7d5c None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:30.210761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb74bd-a29d-42c4-8f4f-8c7b4d8c42ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:30.211841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb74bd-a29d-42c4-8f4f-8c7b4d8c42ad service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:30.212288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb74bd-a29d-42c4-8f4f-8c7b4d8c42ad service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:30.212760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb74bd-a29d-42c4-8f4f-8c7b4d8c42ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:30.239185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:30.261699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb74bd-a29d-42c4-8f4f-8c7b4d8c42ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:30.263432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb74bd-a29d-42c4-8f4f-8c7b4d8c42ad service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:30.277697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9695d2-7343-4539-a2f6-baf661cc4e75 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:30.279224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1d9695d2-7343-4539-a2f6-baf661cc4e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:30.279936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 822/1665] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:30.337763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9695d2-7343-4539-a2f6-baf661cc4e75 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:30.359533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:30.368716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:30.369194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:30.371482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] PATH_INFO: `/v3/projects/f047c816ad8a4a46be5efc220d8ca33d` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:30.388081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f047c816ad8a4a46be5efc220d8ca33d)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:30.395346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:30.610131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f047c816ad8a4a46be5efc220d8ca33d', 'request_id': 'req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:30.651596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f047c816ad8a4a46be5efc220d8ca33d', 'request_id': 'req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:30.686444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f047c816ad8a4a46be5efc220d8ca33d', 'request_id': 'req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:30.710161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] The token cache is being invalidate because project f047c816ad8a4a46be5efc220d8ca33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:50:30.710916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:30.712095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-dd39cb55-f523-4bb4-b2f6-5e6f943a42aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:30.715073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 844/1666] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:50:30 2022] DELETE /identity/v3/projects/f047c816ad8a4a46be5efc220d8ca33d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:30.720244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97e098-33ff-4475-a73c-70c0dba538d4 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:30.720755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97e098-33ff-4475-a73c-70c0dba538d4 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:30.720828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97e098-33ff-4475-a73c-70c0dba538d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:30.762134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-bf97e098-33ff-4475-a73c-70c0dba538d4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:30.763566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-bf97e098-33ff-4475-a73c-70c0dba538d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:30.941227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 823/1667] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:30.948072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906f75-a1a3-4483-8c55-323ac45e80ec None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:30.948610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906f75-a1a3-4483-8c55-323ac45e80ec None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:30.948879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1906f75-a1a3-4483-8c55-323ac45e80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:30.992347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d1906f75-a1a3-4483-8c55-323ac45e80ec None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:30.997395 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d1906f75-a1a3-4483-8c55-323ac45e80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:31.024368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97e098-33ff-4475-a73c-70c0dba538d4 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:31.024631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 845/1668] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:31.041708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97e098-33ff-4475-a73c-70c0dba538d4 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:31.080923 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7b83f-f8f0-4425-abd2-97cce798147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:31.081769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7b83f-f8f0-4425-abd2-97cce798147a admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.082065 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7b83f-f8f0-4425-abd2-97cce798147a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.082343 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7b83f-f8f0-4425-abd2-97cce798147a admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.083139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7b83f-f8f0-4425-abd2-97cce798147a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:31.083451 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7b83f-f8f0-4425-abd2-97cce798147a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:31.085264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7b83f-f8f0-4425-abd2-97cce798147a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:31.129692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 824/1669] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:50:31.135814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1906f75-a1a3-4483-8c55-323ac45e80ec None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:31.150263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:31.170497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1906f75-a1a3-4483-8c55-323ac45e80ec None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:31.186257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b494c-8a48-4e9e-a6e1-20f0250bee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:31.188811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b494c-8a48-4e9e-a6e1-20f0250bee70 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.189407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b494c-8a48-4e9e-a6e1-20f0250bee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.190003 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b494c-8a48-4e9e-a6e1-20f0250bee70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.190928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b494c-8a48-4e9e-a6e1-20f0250bee70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:31.193034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b494c-8a48-4e9e-a6e1-20f0250bee70 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:31.262463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 846/1670] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:31 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:31.266905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7b83f-f8f0-4425-abd2-97cce798147a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:31.281505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7b83f-f8f0-4425-abd2-97cce798147a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:31.428025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64c1b4-a465-4a1b-a169-53b7d94be76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:31.429978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64c1b4-a465-4a1b-a169-53b7d94be76f admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.430272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64c1b4-a465-4a1b-a169-53b7d94be76f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.432221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64c1b4-a465-4a1b-a169-53b7d94be76f admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.433695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64c1b4-a465-4a1b-a169-53b7d94be76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:31.436616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64c1b4-a465-4a1b-a169-53b7d94be76f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:31.486474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 825/1671] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:31 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:50:31.489758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b494c-8a48-4e9e-a6e1-20f0250bee70 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:31.517215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b494c-8a48-4e9e-a6e1-20f0250bee70 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:31.532747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e7b9e-014d-4d15-9c44-8d0568cf61e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:31.533559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e7b9e-014d-4d15-9c44-8d0568cf61e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.535489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e7b9e-014d-4d15-9c44-8d0568cf61e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.535986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e7b9e-014d-4d15-9c44-8d0568cf61e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.537758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e7b9e-014d-4d15-9c44-8d0568cf61e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:31.538416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64c1b4-a465-4a1b-a169-53b7d94be76f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:31.540851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e7b9e-014d-4d15-9c44-8d0568cf61e6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:31.542972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8c64c1b4-a465-4a1b-a169-53b7d94be76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:31.567863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64c1b4-a465-4a1b-a169-53b7d94be76f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:31.578969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:31.580549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.581209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.581653 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] PATH_INFO: `/v3/users/b1db987d3ae24618b5ea92ff0f265fdd` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.584140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1db987d3ae24618b5ea92ff0f265fdd)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:31.590268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:31.590473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 847/1672] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:31.591281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e7b9e-014d-4d15-9c44-8d0568cf61e6 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:31.636795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e7b9e-014d-4d15-9c44-8d0568cf61e6 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:31.655157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163a93d-9915-481c-b58c-417570c4f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:31.655845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163a93d-9915-481c-b58c-417570c4f030 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.656136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163a93d-9915-481c-b58c-417570c4f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.656468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163a93d-9915-481c-b58c-417570c4f030 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.657161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163a93d-9915-481c-b58c-417570c4f030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:31.658821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163a93d-9915-481c-b58c-417570c4f030 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:31.706864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 848/1673] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:31.707862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163a93d-9915-481c-b58c-417570c4f030 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:31.749057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163a93d-9915-481c-b58c-417570c4f030 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:31.760985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1db987d3ae24618b5ea92ff0f265fdd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:31.778618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e9f6d-b19c-4b8c-b600-8f1451ae9707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:31.779570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e9f6d-b19c-4b8c-b600-8f1451ae9707 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.779857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e9f6d-b19c-4b8c-b600-8f1451ae9707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.780131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e9f6d-b19c-4b8c-b600-8f1451ae9707 admin admin] PATH_INFO: `/v3/projects/4bfd749ee56c453eae37f0ccc87019e1/users/3d6f1d4dc86a48a88f6e027e7fcb4f38/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.797125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1db987d3ae24618b5ea92ff0f265fdd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:31.799702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1db987d3ae24618b5ea92ff0f265fdd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:31.811584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:31.833927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1db987d3ae24618b5ea92ff0f265fdd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:31.859716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e9f6d-b19c-4b8c-b600-8f1451ae9707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfd749ee56c453eae37f0ccc87019e1, user_id=3d6f1d4dc86a48a88f6e027e7fcb4f38, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:31.862636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e9f6d-b19c-4b8c-b600-8f1451ae9707 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:31.864891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1f63b5f-ce8a-4c56-81de-e6a031f74f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1db987d3ae24618b5ea92ff0f265fdd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:31.877860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 826/1674] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:50:31 2022] DELETE /identity/v3/users/b1db987d3ae24618b5ea92ff0f265fdd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:31.883268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0f2e-5954-46bf-930c-fb45a3ac70ae None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.883676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0f2e-5954-46bf-930c-fb45a3ac70ae None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.884218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0f2e-5954-46bf-930c-fb45a3ac70ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.924442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 849/1675] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:31 2022] PUT /identity/v3/projects/4bfd749ee56c453eae37f0ccc87019e1/users/3d6f1d4dc86a48a88f6e027e7fcb4f38/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:31.927884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2916c-6ae0-44f2-b365-f1d9833dc48f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:31.927884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2916c-6ae0-44f2-b365-f1d9833dc48f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:31.928156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2916c-6ae0-44f2-b365-f1d9833dc48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:31.934362 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e46c0f2e-5954-46bf-930c-fb45a3ac70ae None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:31.936438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e46c0f2e-5954-46bf-930c-fb45a3ac70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:31.993763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-adc2916c-6ae0-44f2-b365-f1d9833dc48f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:31.995042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-adc2916c-6ae0-44f2-b365-f1d9833dc48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:32.201814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 827/1676] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:32.241914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 850/1677] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:50:32.291386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c0f2e-5954-46bf-930c-fb45a3ac70ae None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:32.293884 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e46c0f2e-5954-46bf-930c-fb45a3ac70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:32.301686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2916c-6ae0-44f2-b365-f1d9833dc48f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:32.305671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-adc2916c-6ae0-44f2-b365-f1d9833dc48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:32.529690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2916c-6ae0-44f2-b365-f1d9833dc48f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:32.547378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da851a-d3b3-4d1b-ae32-92af22d1d99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:32.548444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da851a-d3b3-4d1b-ae32-92af22d1d99f service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:32.548831 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da851a-d3b3-4d1b-ae32-92af22d1d99f service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:32.549213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da851a-d3b3-4d1b-ae32-92af22d1d99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:32.561932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c0f2e-5954-46bf-930c-fb45a3ac70ae None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:32.579228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c28a-d7a7-4169-9732-5eef360ace5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:32.589334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c28a-d7a7-4169-9732-5eef360ace5c service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:32.590025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c28a-d7a7-4169-9732-5eef360ace5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:32.590545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c28a-d7a7-4169-9732-5eef360ace5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:32.611053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da851a-d3b3-4d1b-ae32-92af22d1d99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:32.616294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da851a-d3b3-4d1b-ae32-92af22d1d99f service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:32.629299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c28a-d7a7-4169-9732-5eef360ace5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:32.635487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c28a-d7a7-4169-9732-5eef360ace5c service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:32.657792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 851/1678] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:50:32.662119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 828/1679] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:32.993429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2b14a-8b5d-4824-9f00-7b1359629c03 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:32.993810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2b14a-8b5d-4824-9f00-7b1359629c03 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:32.994354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2b14a-8b5d-4824-9f00-7b1359629c03 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:32.997427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 852/1680] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jun 16 18:50:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:33.002985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c571ac-9917-4022-bb34-1cb37ef42f40 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:33.003651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c571ac-9917-4022-bb34-1cb37ef42f40 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:33.003935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c571ac-9917-4022-bb34-1cb37ef42f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:33.095209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f1c571ac-9917-4022-bb34-1cb37ef42f40 None None] MFA Rules not processed for user `e11a8567e1254a0080cbe74efe0127f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:33.096622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f1c571ac-9917-4022-bb34-1cb37ef42f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:33.122737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 829/1681] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:50:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:33.304534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2b14a-8b5d-4824-9f00-7b1359629c03 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:33.355709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2b14a-8b5d-4824-9f00-7b1359629c03 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:33.372796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d2bf-0cac-4596-9acd-eb5fff616c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:33.373480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d2bf-0cac-4596-9acd-eb5fff616c46 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:33.373786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d2bf-0cac-4596-9acd-eb5fff616c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:33.374052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d2bf-0cac-4596-9acd-eb5fff616c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:33.426085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0d2bf-0cac-4596-9acd-eb5fff616c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:33.428550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0d2bf-0cac-4596-9acd-eb5fff616c46 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:33.464913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 853/1682] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:34.060949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ae979-919d-479b-8a46-e83b96fef178 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:34.061864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ae979-919d-479b-8a46-e83b96fef178 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:34.061864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ae979-919d-479b-8a46-e83b96fef178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:34.115901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-4d8ae979-919d-479b-8a46-e83b96fef178 None None] MFA Rules not processed for user `c4dfdeb737d149d881bc9cbd9116cd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:34.118014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4d8ae979-919d-479b-8a46-e83b96fef178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:34.218885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:34.233043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 830/1683] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:34.251184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d2bf-0cac-4596-9acd-eb5fff616c46 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:34.252947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-79d0d2bf-0cac-4596-9acd-eb5fff616c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:34.306081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:34.409344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d2bf-0cac-4596-9acd-eb5fff616c46 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:34.425275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d548868-f6ba-47c8-b87d-ee3eca73fe21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:34.426783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d548868-f6ba-47c8-b87d-ee3eca73fe21 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:34.427365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d548868-f6ba-47c8-b87d-ee3eca73fe21 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:34.427848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d548868-f6ba-47c8-b87d-ee3eca73fe21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:34.454515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d548868-f6ba-47c8-b87d-ee3eca73fe21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:34.456693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d548868-f6ba-47c8-b87d-ee3eca73fe21 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:34.490019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 854/1684] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:50:36.150560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c3287-eb7f-4552-a0e3-a2eb3e853f4b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:36.151507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c3287-eb7f-4552-a0e3-a2eb3e853f4b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:36.152738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c3287-eb7f-4552-a0e3-a2eb3e853f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:36.226744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f60c3287-eb7f-4552-a0e3-a2eb3e853f4b None None] MFA Rules not processed for user `d3b7491e67544485bc964386ed5946bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:36.231486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f60c3287-eb7f-4552-a0e3-a2eb3e853f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:36.475852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 831/1685] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:36.493919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d548868-f6ba-47c8-b87d-ee3eca73fe21 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:36.496654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5d548868-f6ba-47c8-b87d-ee3eca73fe21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:36.515975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c3287-eb7f-4552-a0e3-a2eb3e853f4b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:36.529147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d548868-f6ba-47c8-b87d-ee3eca73fe21 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:36.532354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f60c3287-eb7f-4552-a0e3-a2eb3e853f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:36.551222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ba75e-8cf5-42aa-8235-23143e278202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:36.552016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba75e-8cf5-42aa-8235-23143e278202 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:36.552309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba75e-8cf5-42aa-8235-23143e278202 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:36.552592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba75e-8cf5-42aa-8235-23143e278202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:36.581942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ba75e-8cf5-42aa-8235-23143e278202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:36.592551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ba75e-8cf5-42aa-8235-23143e278202 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:36.609588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c3287-eb7f-4552-a0e3-a2eb3e853f4b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:36.627738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:36.628785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:36.629173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:36.629548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] PATH_INFO: `/v3/projects/cf5941c4e8fb47aa82c0abe988f2b722` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:36.640093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 855/1686] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:36.641323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5941c4e8fb47aa82c0abe988f2b722)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:36.643476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e9fec-197d-468d-9c6d-0942ca4ddf7c None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:36.643689 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:36.650463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e9fec-197d-468d-9c6d-0942ca4ddf7c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:36.651476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e9fec-197d-468d-9c6d-0942ca4ddf7c None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:36.663257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 856/1687] 10.222.0.40 () {54 vars in 960 bytes} [Thu Jun 16 18:50:36 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:36.678137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46eb04-916a-42af-be41-72bd9b78c096 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:36.679052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46eb04-916a-42af-be41-72bd9b78c096 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:36.679762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46eb04-916a-42af-be41-72bd9b78c096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:36.723676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4d46eb04-916a-42af-be41-72bd9b78c096 None None] MFA Rules not processed for user `167e32465f314f4caf9f8df4a4710dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:36.726893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4d46eb04-916a-42af-be41-72bd9b78c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:36.778288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5941c4e8fb47aa82c0abe988f2b722', 'request_id': 'req-82c8885d-7d8e-45df-b49d-ada4446ef117'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:36.800221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5941c4e8fb47aa82c0abe988f2b722', 'request_id': 'req-82c8885d-7d8e-45df-b49d-ada4446ef117'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:36.814353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5941c4e8fb47aa82c0abe988f2b722', 'request_id': 'req-82c8885d-7d8e-45df-b49d-ada4446ef117'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:36.851918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] The token cache is being invalidate because project cf5941c4e8fb47aa82c0abe988f2b722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:50:36.852365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:36.853695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82c8885d-7d8e-45df-b49d-ada4446ef117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:36.863716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 832/1688] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:50:36 2022] DELETE /identity/v3/projects/cf5941c4e8fb47aa82c0abe988f2b722 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:36.863716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9efab-e4b4-40d5-a445-9060fb69d196 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:36.863716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9efab-e4b4-40d5-a445-9060fb69d196 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:36.863716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9efab-e4b4-40d5-a445-9060fb69d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:36.915486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-dfe9efab-e4b4-40d5-a445-9060fb69d196 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:36.917524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dfe9efab-e4b4-40d5-a445-9060fb69d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:37.010688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 857/1689] 10.222.0.40 () {58 vars in 1057 bytes} [Thu Jun 16 18:50:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:37.021593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46eb04-916a-42af-be41-72bd9b78c096 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:37.051301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46eb04-916a-42af-be41-72bd9b78c096 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:37.071888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 833/1690] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:37.074315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f6d64-5619-4fba-aa9f-0a50e8fc6ced None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:37.074747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f6d64-5619-4fba-aa9f-0a50e8fc6ced None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:37.075142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f6d64-5619-4fba-aa9f-0a50e8fc6ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:37.114196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-b81f6d64-5619-4fba-aa9f-0a50e8fc6ced None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:37.115628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b81f6d64-5619-4fba-aa9f-0a50e8fc6ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:37.138675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 834/1691] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:37.143170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f6d64-5619-4fba-aa9f-0a50e8fc6ced None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:37.156231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:37.163842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f6d64-5619-4fba-aa9f-0a50e8fc6ced None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:37.192817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa75c6-41b6-4cac-bcfb-519a50d96e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:37.193661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa75c6-41b6-4cac-bcfb-519a50d96e75 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:37.194021 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa75c6-41b6-4cac-bcfb-519a50d96e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:37.194410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa75c6-41b6-4cac-bcfb-519a50d96e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:37.195264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa75c6-41b6-4cac-bcfb-519a50d96e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:37.195704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa75c6-41b6-4cac-bcfb-519a50d96e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:37.199554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa75c6-41b6-4cac-bcfb-519a50d96e75 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:37.263687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 835/1692] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:37.265455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7922995-ab51-4e20-b5c4-4c3bc89d266f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:37.265908 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7922995-ab51-4e20-b5c4-4c3bc89d266f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:37.266329 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7922995-ab51-4e20-b5c4-4c3bc89d266f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:37.282219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37323a7-be07-4a1c-98e9-8c1e9db01ddd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:37.284139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37323a7-be07-4a1c-98e9-8c1e9db01ddd service placement] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:37.284807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37323a7-be07-4a1c-98e9-8c1e9db01ddd service placement] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:37.285197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37323a7-be07-4a1c-98e9-8c1e9db01ddd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:37.291508 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b37323a7-be07-4a1c-98e9-8c1e9db01ddd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:37.324547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37323a7-be07-4a1c-98e9-8c1e9db01ddd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:37.329436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37323a7-be07-4a1c-98e9-8c1e9db01ddd service placement] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:37.363542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f7922995-ab51-4e20-b5c4-4c3bc89d266f None None] MFA Rules not processed for user `aacb60b92e9346dda3f4e2c43885a883`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:37.367188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f7922995-ab51-4e20-b5c4-4c3bc89d266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:37.373990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 858/1693] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:37.377864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37323a7-be07-4a1c-98e9-8c1e9db01ddd service placement] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:37.418596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37323a7-be07-4a1c-98e9-8c1e9db01ddd service placement] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:37.446182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a36654-b1f2-4659-b1b4-a2430ad8b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:37.450564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a36654-b1f2-4659-b1b4-a2430ad8b72d admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:37.451454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a36654-b1f2-4659-b1b4-a2430ad8b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:37.451863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a36654-b1f2-4659-b1b4-a2430ad8b72d admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:37.455242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a36654-b1f2-4659-b1b4-a2430ad8b72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:37.462914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a36654-b1f2-4659-b1b4-a2430ad8b72d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:37.543121 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:37.556115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 859/1694] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:37 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:37.557648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a36654-b1f2-4659-b1b4-a2430ad8b72d admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:37.612100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 836/1695] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:37.636593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7943dc8-693f-4ea7-9d67-9348d1620930 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:37.636883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7943dc8-693f-4ea7-9d67-9348d1620930 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:37.637162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7943dc8-693f-4ea7-9d67-9348d1620930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:37.684563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c7943dc8-693f-4ea7-9d67-9348d1620930 None None] MFA Rules not processed for user `aacb60b92e9346dda3f4e2c43885a883`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:37.685470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c7943dc8-693f-4ea7-9d67-9348d1620930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:37.752269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a36654-b1f2-4659-b1b4-a2430ad8b72d admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:37.768589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea2ee6-5d8b-4a78-96b0-bade4fb93c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:37.769874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea2ee6-5d8b-4a78-96b0-bade4fb93c34 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:37.769874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea2ee6-5d8b-4a78-96b0-bade4fb93c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:37.770292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea2ee6-5d8b-4a78-96b0-bade4fb93c34 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:37.771176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea2ee6-5d8b-4a78-96b0-bade4fb93c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:37.773702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea2ee6-5d8b-4a78-96b0-bade4fb93c34 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:37.812273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 837/1696] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:50:37.814546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7943dc8-693f-4ea7-9d67-9348d1620930 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:37.817045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c7943dc8-693f-4ea7-9d67-9348d1620930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:37.829326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 860/1697] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:37 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:37.830810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea2ee6-5d8b-4a78-96b0-bade4fb93c34 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:37.834888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a6ea2ee6-5d8b-4a78-96b0-bade4fb93c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:37.858794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7943dc8-693f-4ea7-9d67-9348d1620930 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:37.911171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:37.918798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:37.918798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:37.918798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] PATH_INFO: `/v3/users/1c95f71f0c6742649721b15e60cdc45c` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:37.925500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c95f71f0c6742649721b15e60cdc45c)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:37.928627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:38.038302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea2ee6-5d8b-4a78-96b0-bade4fb93c34 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:38.052484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a94a2-7b97-4fa1-9b1c-25d36c5cfe26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:38.053422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a94a2-7b97-4fa1-9b1c-25d36c5cfe26 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.053893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a94a2-7b97-4fa1-9b1c-25d36c5cfe26 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.054316 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a94a2-7b97-4fa1-9b1c-25d36c5cfe26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.067653 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c95f71f0c6742649721b15e60cdc45c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:38.079220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a94a2-7b97-4fa1-9b1c-25d36c5cfe26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:38.087683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a94a2-7b97-4fa1-9b1c-25d36c5cfe26 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:38.109121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c95f71f0c6742649721b15e60cdc45c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:38.110513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c95f71f0c6742649721b15e60cdc45c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:38.132098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 861/1698] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:38.133500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a94a2-7b97-4fa1-9b1c-25d36c5cfe26 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:38.164287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c95f71f0c6742649721b15e60cdc45c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:38.181810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a94a2-7b97-4fa1-9b1c-25d36c5cfe26 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:38.194995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b6de95b4-dfd8-4270-8f04-5fb14ae132bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c95f71f0c6742649721b15e60cdc45c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:38.197459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:38.209238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5380c-5e52-4c3c-9e41-2445343d623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:38.210355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5380c-5e52-4c3c-9e41-2445343d623f admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.212702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 838/1699] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:50:37 2022] DELETE /identity/v3/users/1c95f71f0c6742649721b15e60cdc45c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:38.212849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5380c-5e52-4c3c-9e41-2445343d623f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.213148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5380c-5e52-4c3c-9e41-2445343d623f admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.217289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5380c-5e52-4c3c-9e41-2445343d623f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:38.221842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bddad-3dcf-4049-8cb9-1460e83edc73 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.222247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bddad-3dcf-4049-8cb9-1460e83edc73 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.222593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bddad-3dcf-4049-8cb9-1460e83edc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.231992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5380c-5e52-4c3c-9e41-2445343d623f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:38.283904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7f9bddad-3dcf-4049-8cb9-1460e83edc73 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:38.288524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7f9bddad-3dcf-4049-8cb9-1460e83edc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:38.316108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 862/1700] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:38.319131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34afcc3-a34d-48f5-9f8d-fbd5c286c1bd None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.330267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34afcc3-a34d-48f5-9f8d-fbd5c286c1bd None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.331155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34afcc3-a34d-48f5-9f8d-fbd5c286c1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.450282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 839/1701] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:38.456948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bddad-3dcf-4049-8cb9-1460e83edc73 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:38.465209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7f9bddad-3dcf-4049-8cb9-1460e83edc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:38.466797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e34afcc3-a34d-48f5-9f8d-fbd5c286c1bd None None] MFA Rules not processed for user `3d6f1d4dc86a48a88f6e027e7fcb4f38`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:38.468755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e34afcc3-a34d-48f5-9f8d-fbd5c286c1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:38.536232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bddad-3dcf-4049-8cb9-1460e83edc73 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:38.571822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe53d-66a2-41ab-bc2f-423c3df5480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:38.573403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe53d-66a2-41ab-bc2f-423c3df5480c admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.574494 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe53d-66a2-41ab-bc2f-423c3df5480c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.578586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe53d-66a2-41ab-bc2f-423c3df5480c admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.580212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efe53d-66a2-41ab-bc2f-423c3df5480c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:38.583562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efe53d-66a2-41ab-bc2f-423c3df5480c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:38.616698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:38.642415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 863/1702] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:38.642415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34afcc3-a34d-48f5-9f8d-fbd5c286c1bd None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:38.643250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e34afcc3-a34d-48f5-9f8d-fbd5c286c1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:38.667881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 840/1703] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:38.672155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe53d-66a2-41ab-bc2f-423c3df5480c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:38.690865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c1efe53d-66a2-41ab-bc2f-423c3df5480c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:38.738574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe53d-66a2-41ab-bc2f-423c3df5480c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:38.741850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34afcc3-a34d-48f5-9f8d-fbd5c286c1bd None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:38.749735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdebf0-0e1e-462b-89fd-2eaa4b6d18b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:38.750495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdebf0-0e1e-462b-89fd-2eaa4b6d18b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.750783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdebf0-0e1e-462b-89fd-2eaa4b6d18b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.751952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc1a53-81a7-43b1-abca-476c6f763c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:38.752641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc1a53-81a7-43b1-abca-476c6f763c6a admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:38.752925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc1a53-81a7-43b1-abca-476c6f763c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:38.753201 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc1a53-81a7-43b1-abca-476c6f763c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.753914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc1a53-81a7-43b1-abca-476c6f763c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:38.754176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdebf0-0e1e-462b-89fd-2eaa4b6d18b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:38.765391 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc1a53-81a7-43b1-abca-476c6f763c6a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:38.819408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdebf0-0e1e-462b-89fd-2eaa4b6d18b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:38.829816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdebf0-0e1e-462b-89fd-2eaa4b6d18b8 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:38.848687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 841/1704] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:38 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:38.848687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc1a53-81a7-43b1-abca-476c6f763c6a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:38.861684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 864/1705] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:38.866720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdebf0-0e1e-462b-89fd-2eaa4b6d18b8 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:38.905115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdebf0-0e1e-462b-89fd-2eaa4b6d18b8 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:39.027045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc1a53-81a7-43b1-abca-476c6f763c6a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:39.043145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d93b-55ce-4357-b000-5487af6ec952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:39.044082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d93b-55ce-4357-b000-5487af6ec952 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:39.044364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d93b-55ce-4357-b000-5487af6ec952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:39.044640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d93b-55ce-4357-b000-5487af6ec952 admin admin] PATH_INFO: `/v3/projects/ab3aa3d053fd4cb3b1dbbdd0931e9c14/users/1b00f9912dae497aa5151ed9afd03ffa/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:39.085824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95d93b-55ce-4357-b000-5487af6ec952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3aa3d053fd4cb3b1dbbdd0931e9c14, user_id=1b00f9912dae497aa5151ed9afd03ffa, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:39.089723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95d93b-55ce-4357-b000-5487af6ec952 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:39.132660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 842/1706] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:38 2022] PUT /identity/v3/projects/ab3aa3d053fd4cb3b1dbbdd0931e9c14/users/1b00f9912dae497aa5151ed9afd03ffa/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:39.155460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5578b85-78ef-45cf-9cab-32757ebad548 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:39.155773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5578b85-78ef-45cf-9cab-32757ebad548 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:39.156052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5578b85-78ef-45cf-9cab-32757ebad548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:39.217624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-b5578b85-78ef-45cf-9cab-32757ebad548 None None] MFA Rules not processed for user `1b00f9912dae497aa5151ed9afd03ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:39.221583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b5578b85-78ef-45cf-9cab-32757ebad548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:39.295750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4412d5-cee5-4ea9-9da5-7c5a3561fa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:39.296789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4412d5-cee5-4ea9-9da5-7c5a3561fa51 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:39.297229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4412d5-cee5-4ea9-9da5-7c5a3561fa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:39.297635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4412d5-cee5-4ea9-9da5-7c5a3561fa51 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:39.299063 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4412d5-cee5-4ea9-9da5-7c5a3561fa51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:39.319348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4412d5-cee5-4ea9-9da5-7c5a3561fa51 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:39.347644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:39.392967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 865/1707] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:38 2022] POST /identity/v3/users => generated 291 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:39.394799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5747ccc-c60d-4eac-971a-04579662bf85 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:39.397120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5747ccc-c60d-4eac-971a-04579662bf85 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:39.398253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5747ccc-c60d-4eac-971a-04579662bf85 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:39.402693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 866/1708] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jun 16 18:50:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:39.406223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5747ccc-c60d-4eac-971a-04579662bf85 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:39.441413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 843/1709] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:39.443872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba6da0-70ef-4143-8a1d-62fa14583ca6 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:39.444367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba6da0-70ef-4143-8a1d-62fa14583ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:39.444790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba6da0-70ef-4143-8a1d-62fa14583ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:39.476666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ddba6da0-70ef-4143-8a1d-62fa14583ca6 None None] MFA Rules not processed for user `e11a8567e1254a0080cbe74efe0127f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:39.488190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ddba6da0-70ef-4143-8a1d-62fa14583ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:39.533307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5747ccc-c60d-4eac-971a-04579662bf85 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:39.540357 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1057a-fd95-4fd2-9fe5-9cc012ecda2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:39.541090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1057a-fd95-4fd2-9fe5-9cc012ecda2b admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:39.541432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1057a-fd95-4fd2-9fe5-9cc012ecda2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:39.541687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1057a-fd95-4fd2-9fe5-9cc012ecda2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:39.543181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1057a-fd95-4fd2-9fe5-9cc012ecda2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:39.546688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1057a-fd95-4fd2-9fe5-9cc012ecda2b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:39.564150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 867/1710] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:39.565171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1057a-fd95-4fd2-9fe5-9cc012ecda2b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:39.580778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1057a-fd95-4fd2-9fe5-9cc012ecda2b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:39.587521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43e1dc-c16d-47bc-bec3-0ee81594858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:39.588225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43e1dc-c16d-47bc-bec3-0ee81594858f admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:39.588519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43e1dc-c16d-47bc-bec3-0ee81594858f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:39.588807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43e1dc-c16d-47bc-bec3-0ee81594858f admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:39.589653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43e1dc-c16d-47bc-bec3-0ee81594858f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:39.592504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43e1dc-c16d-47bc-bec3-0ee81594858f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:39.644678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:39.654616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 868/1711] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:39 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:39.657349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43e1dc-c16d-47bc-bec3-0ee81594858f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:39.722972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 844/1712] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:39.724764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba6da0-70ef-4143-8a1d-62fa14583ca6 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:39.809697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba6da0-70ef-4143-8a1d-62fa14583ca6 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:39.816173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43e1dc-c16d-47bc-bec3-0ee81594858f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:39.823282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12807-2848-47b4-a19c-ebd648fbb98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:39.825058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12807-2848-47b4-a19c-ebd648fbb98a admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:39.825483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12807-2848-47b4-a19c-ebd648fbb98a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:39.826363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12807-2848-47b4-a19c-ebd648fbb98a admin admin] PATH_INFO: `/v3/projects/d7940004af3c4e32b359ec4a5cff5e7d/users/e647d093c505401bba6d5de61662f5c9/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:39.832494 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a64eb-519e-4f22-b5ae-2f8c9711c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:39.833207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a64eb-519e-4f22-b5ae-2f8c9711c80c admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:39.833496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a64eb-519e-4f22-b5ae-2f8c9711c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:39.833893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a64eb-519e-4f22-b5ae-2f8c9711c80c admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:39.834642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a64eb-519e-4f22-b5ae-2f8c9711c80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:39.836603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a64eb-519e-4f22-b5ae-2f8c9711c80c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:39.851491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f12807-2848-47b4-a19c-ebd648fbb98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7940004af3c4e32b359ec4a5cff5e7d, user_id=e647d093c505401bba6d5de61662f5c9, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:39.857013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f12807-2848-47b4-a19c-ebd648fbb98a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:39.880407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 869/1713] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:39 2022] PUT /identity/v3/projects/d7940004af3c4e32b359ec4a5cff5e7d/users/e647d093c505401bba6d5de61662f5c9/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:39.881973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12807-2848-47b4-a19c-ebd648fbb98a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:39.884615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-53f12807-2848-47b4-a19c-ebd648fbb98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:39.905911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 845/1714] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:39 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:39.910677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a64eb-519e-4f22-b5ae-2f8c9711c80c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:39.935341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a64eb-519e-4f22-b5ae-2f8c9711c80c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:40.000468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12807-2848-47b4-a19c-ebd648fbb98a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:40.011173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff846d2-156b-45e5-b101-3986326b9d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:40.011875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff846d2-156b-45e5-b101-3986326b9d17 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.012162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff846d2-156b-45e5-b101-3986326b9d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.013930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff846d2-156b-45e5-b101-3986326b9d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.040080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff846d2-156b-45e5-b101-3986326b9d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:40.057643 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff846d2-156b-45e5-b101-3986326b9d17 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:40.084567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 870/1715] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:40.086115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff846d2-156b-45e5-b101-3986326b9d17 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:40.099716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443c967-078c-4533-9b85-d81b652a720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:40.100026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c967-078c-4533-9b85-d81b652a720e admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.100311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c967-078c-4533-9b85-d81b652a720e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.100728 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443c967-078c-4533-9b85-d81b652a720e admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.101736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443c967-078c-4533-9b85-d81b652a720e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:40.103820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443c967-078c-4533-9b85-d81b652a720e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:40.129823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff846d2-156b-45e5-b101-3986326b9d17 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:40.138477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 846/1716] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:40.140396 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443c967-078c-4533-9b85-d81b652a720e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:40.149061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588bf4-57e3-4373-ac7e-8ea826f4e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:40.150245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588bf4-57e3-4373-ac7e-8ea826f4e247 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.150786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588bf4-57e3-4373-ac7e-8ea826f4e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.151277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588bf4-57e3-4373-ac7e-8ea826f4e247 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.152732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588bf4-57e3-4373-ac7e-8ea826f4e247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:40.155889 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588bf4-57e3-4373-ac7e-8ea826f4e247 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:40.180944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443c967-078c-4533-9b85-d81b652a720e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:40.205207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 871/1717] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:40.212465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588bf4-57e3-4373-ac7e-8ea826f4e247 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:40.219291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cbebf-531d-4e78-8bc3-0d7c4b08e220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:40.220943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cbebf-531d-4e78-8bc3-0d7c4b08e220 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.221465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cbebf-531d-4e78-8bc3-0d7c4b08e220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.221954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cbebf-531d-4e78-8bc3-0d7c4b08e220 admin admin] PATH_INFO: `/v3/projects/d7940004af3c4e32b359ec4a5cff5e7d/users/e647d093c505401bba6d5de61662f5c9/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.236406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588bf4-57e3-4373-ac7e-8ea826f4e247 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:40.244146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f2aa8-0c0e-4312-b313-69bb0457f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:40.246149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f2aa8-0c0e-4312-b313-69bb0457f661 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.246512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f2aa8-0c0e-4312-b313-69bb0457f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.246801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f2aa8-0c0e-4312-b313-69bb0457f661 admin admin] PATH_INFO: `/v3/projects/19f27087e327459e8e84fdaf06388cbf/users/4370e2b115a747bb865152a8fac6f678/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.249752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cbebf-531d-4e78-8bc3-0d7c4b08e220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7940004af3c4e32b359ec4a5cff5e7d, user_id=e647d093c505401bba6d5de61662f5c9, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:40.261581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cbebf-531d-4e78-8bc3-0d7c4b08e220 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:40.269348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f2aa8-0c0e-4312-b313-69bb0457f661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f27087e327459e8e84fdaf06388cbf, user_id=4370e2b115a747bb865152a8fac6f678, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:40.274302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f2aa8-0c0e-4312-b313-69bb0457f661 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:40.308546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 872/1718] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:40 2022] PUT /identity/v3/projects/19f27087e327459e8e84fdaf06388cbf/users/4370e2b115a747bb865152a8fac6f678/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:40.313873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f2aa8-0c0e-4312-b313-69bb0457f661 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:40.326350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 847/1719] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:40 2022] PUT /identity/v3/projects/d7940004af3c4e32b359ec4a5cff5e7d/users/e647d093c505401bba6d5de61662f5c9/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:40.500131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:40.541927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f2aa8-0c0e-4312-b313-69bb0457f661 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:40.695566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310c226-7c9c-43e1-8d95-c242d79b9af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:40.696838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310c226-7c9c-43e1-8d95-c242d79b9af6 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.699213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310c226-7c9c-43e1-8d95-c242d79b9af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.699771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310c226-7c9c-43e1-8d95-c242d79b9af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.702669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310c226-7c9c-43e1-8d95-c242d79b9af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:40.710405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310c226-7c9c-43e1-8d95-c242d79b9af6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:40.768384 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cbebf-531d-4e78-8bc3-0d7c4b08e220 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:40.784511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 873/1720] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:40.816474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cbebf-531d-4e78-8bc3-0d7c4b08e220 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:40.835108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d45a0-51e7-4161-8958-8c989a439702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:40.838637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d45a0-51e7-4161-8958-8c989a439702 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.839656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d45a0-51e7-4161-8958-8c989a439702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.841944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d45a0-51e7-4161-8958-8c989a439702 admin admin] PATH_INFO: `/v3/projects/19f27087e327459e8e84fdaf06388cbf/users/4370e2b115a747bb865152a8fac6f678/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:40.847921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d45a0-51e7-4161-8958-8c989a439702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f27087e327459e8e84fdaf06388cbf, user_id=4370e2b115a747bb865152a8fac6f678, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:40.861838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d45a0-51e7-4161-8958-8c989a439702 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:40.915594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 848/1721] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:40 2022] PUT /identity/v3/projects/19f27087e327459e8e84fdaf06388cbf/users/4370e2b115a747bb865152a8fac6f678/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:40.937641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e20f-25e3-49cf-9d4a-b7a3f9734f24 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:40.938170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e20f-25e3-49cf-9d4a-b7a3f9734f24 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:40.938713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e20f-25e3-49cf-9d4a-b7a3f9734f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:41.064404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-17e7e20f-25e3-49cf-9d4a-b7a3f9734f24 None None] MFA Rules not processed for user `4370e2b115a747bb865152a8fac6f678`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:41.066657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-17e7e20f-25e3-49cf-9d4a-b7a3f9734f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:41.491060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 874/1722] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 555 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:41.546316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d45a0-51e7-4161-8958-8c989a439702 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:41.549509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-540d45a0-51e7-4161-8958-8c989a439702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:41.650024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e364-4f58-4d84-8025-5f672b579866 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:41.650560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e364-4f58-4d84-8025-5f672b579866 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:41.651071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e364-4f58-4d84-8025-5f672b579866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:41.726291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-9358e364-4f58-4d84-8025-5f672b579866 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:41.732221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9358e364-4f58-4d84-8025-5f672b579866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:41.750008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:41.783525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d45a0-51e7-4161-8958-8c989a439702 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:41.789441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9b4e-bcd2-4bfb-8ad6-72e92186a386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:41.790431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9b4e-bcd2-4bfb-8ad6-72e92186a386 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:41.790894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9b4e-bcd2-4bfb-8ad6-72e92186a386 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:41.791510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9b4e-bcd2-4bfb-8ad6-72e92186a386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:41.823450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9b4e-bcd2-4bfb-8ad6-72e92186a386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:41.826701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9b4e-bcd2-4bfb-8ad6-72e92186a386 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:41.875910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 849/1723] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:41.893558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 875/1724] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:50:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:42.141469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9b4e-bcd2-4bfb-8ad6-72e92186a386 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:42.172265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9b4e-bcd2-4bfb-8ad6-72e92186a386 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:42.187911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adb74b-4b60-44b1-8280-705a95106e3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:42.191489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adb74b-4b60-44b1-8280-705a95106e3d service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:42.192325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adb74b-4b60-44b1-8280-705a95106e3d service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:42.199003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adb74b-4b60-44b1-8280-705a95106e3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:42.267189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358e364-4f58-4d84-8025-5f672b579866 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:42.269289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9358e364-4f58-4d84-8025-5f672b579866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:42.426544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:42.625688 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adb74b-4b60-44b1-8280-705a95106e3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:42.631752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adb74b-4b60-44b1-8280-705a95106e3d service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:42.693904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358e364-4f58-4d84-8025-5f672b579866 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:42.695497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 850/1725] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:42.723687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0261e2-f88d-4219-aea4-d14ff331d2a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:42.724760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0261e2-f88d-4219-aea4-d14ff331d2a1 service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:42.725256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0261e2-f88d-4219-aea4-d14ff331d2a1 service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:42.725740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0261e2-f88d-4219-aea4-d14ff331d2a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:42.769946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0261e2-f88d-4219-aea4-d14ff331d2a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:42.778895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0261e2-f88d-4219-aea4-d14ff331d2a1 service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:42.822936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 876/1726] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:50:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 18:50:43.351986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adb74b-4b60-44b1-8280-705a95106e3d service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:43.360292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8751a6-622b-4952-9a7b-ecf4aec6d169 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:43.360820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8751a6-622b-4952-9a7b-ecf4aec6d169 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:43.364985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-31adb74b-4b60-44b1-8280-705a95106e3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:43.365552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8751a6-622b-4952-9a7b-ecf4aec6d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:43.467530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5a8751a6-622b-4952-9a7b-ecf4aec6d169 None None] MFA Rules not processed for user `c4dfdeb737d149d881bc9cbd9116cd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:43.479991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5a8751a6-622b-4952-9a7b-ecf4aec6d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:43.797148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 877/1727] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:44.021099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adb74b-4b60-44b1-8280-705a95106e3d service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:44.063713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:44.065316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:44.073854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:44.074487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] PATH_INFO: `/v3/projects/68d7a751910d4b05ab48e83cafab8289` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:44.094668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d7a751910d4b05ab48e83cafab8289)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:44.101502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:44.242961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f30ed-cadc-499c-8084-563f420b9d86 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:44.243390 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f30ed-cadc-499c-8084-563f420b9d86 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:44.243911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f30ed-cadc-499c-8084-563f420b9d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:44.253501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d7a751910d4b05ab48e83cafab8289', 'request_id': 'req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:44.281227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d7a751910d4b05ab48e83cafab8289', 'request_id': 'req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:44.296175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d7a751910d4b05ab48e83cafab8289', 'request_id': 'req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:44.297476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-982f30ed-cadc-499c-8084-563f420b9d86 None None] MFA Rules not processed for user `aacb60b92e9346dda3f4e2c43885a883`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:44.305877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-982f30ed-cadc-499c-8084-563f420b9d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:44.357336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] The token cache is being invalidate because project 68d7a751910d4b05ab48e83cafab8289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:50:44.362855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:44.363832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:44.372121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 851/1728] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:50:43 2022] DELETE /identity/v3/projects/68d7a751910d4b05ab48e83cafab8289 => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:44.378254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:44.381652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:44.483788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:44.518309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 878/1729] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:44.698997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab6b9b-1f44-46fe-ae42-dfd365e15ddf admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:44.723829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:44.725310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:44.725764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:44.726224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] PATH_INFO: `/v3/users/24998eebf0a241678b38da20c7eeaf4e` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:44.729047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24998eebf0a241678b38da20c7eeaf4e)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:44.733590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:45.101486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24998eebf0a241678b38da20c7eeaf4e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:45.191924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24998eebf0a241678b38da20c7eeaf4e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:45.193366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24998eebf0a241678b38da20c7eeaf4e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:45.259254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24998eebf0a241678b38da20c7eeaf4e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:45.311504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6f1c80a8-771e-4557-86e6-6e3a1f03dd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24998eebf0a241678b38da20c7eeaf4e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:45.351748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 852/1730] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:50:44 2022] DELETE /identity/v3/users/24998eebf0a241678b38da20c7eeaf4e => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:46.627814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c3ed2-75b3-493e-beb1-32cfd32e2790 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:46.628372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c3ed2-75b3-493e-beb1-32cfd32e2790 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:46.628583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c3ed2-75b3-493e-beb1-32cfd32e2790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:46.685937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-af0c3ed2-75b3-493e-beb1-32cfd32e2790 None None] MFA Rules not processed for user `e11a8567e1254a0080cbe74efe0127f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:46.709197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-af0c3ed2-75b3-493e-beb1-32cfd32e2790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:46.746640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045e813-e95c-432b-a590-78e56be1c101 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:46.747529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045e813-e95c-432b-a590-78e56be1c101 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:46.748180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045e813-e95c-432b-a590-78e56be1c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:46.846879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 879/1731] 10.222.0.60 () {58 vars in 1015 bytes} [Thu Jun 16 18:50:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:46.862102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7045e813-e95c-432b-a590-78e56be1c101 None None] MFA Rules not processed for user `e647d093c505401bba6d5de61662f5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:46.868653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c3ed2-75b3-493e-beb1-32cfd32e2790 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:46.870662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7045e813-e95c-432b-a590-78e56be1c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:46.872409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-af0c3ed2-75b3-493e-beb1-32cfd32e2790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:46.898845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c3ed2-75b3-493e-beb1-32cfd32e2790 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:46.907059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88968c-f8c5-4402-9142-88277a14d41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:46.912428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88968c-f8c5-4402-9142-88277a14d41f service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:46.912700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88968c-f8c5-4402-9142-88277a14d41f service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:46.913337 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88968c-f8c5-4402-9142-88277a14d41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:46.933716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88968c-f8c5-4402-9142-88277a14d41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:46.937588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88968c-f8c5-4402-9142-88277a14d41f service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:46.947399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:46.959507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 880/1732] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:47.160900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 853/1733] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:47.173213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e75d9-96c8-4840-89b2-76d5b8657a02 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:47.174603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e75d9-96c8-4840-89b2-76d5b8657a02 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:47.175090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e75d9-96c8-4840-89b2-76d5b8657a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:47.200599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5f7e75d9-96c8-4840-89b2-76d5b8657a02 None None] MFA Rules not processed for user `3d6f1d4dc86a48a88f6e027e7fcb4f38`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:47.202117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5f7e75d9-96c8-4840-89b2-76d5b8657a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:47.329511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 881/1734] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:50:48.875281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57d3d6-e25c-43f6-bb02-64b41f9709f0 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:48.875796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57d3d6-e25c-43f6-bb02-64b41f9709f0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:48.876077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57d3d6-e25c-43f6-bb02-64b41f9709f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:48.930727 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ee57d3d6-e25c-43f6-bb02-64b41f9709f0 None None] MFA Rules not processed for user `d3b7491e67544485bc964386ed5946bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:48.932064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ee57d3d6-e25c-43f6-bb02-64b41f9709f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:48.958180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:49.090768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e75d9-96c8-4840-89b2-76d5b8657a02 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:49.092474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5f7e75d9-96c8-4840-89b2-76d5b8657a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:49.124328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 854/1735] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:50:49.232370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57d3d6-e25c-43f6-bb02-64b41f9709f0 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:49.235086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ee57d3d6-e25c-43f6-bb02-64b41f9709f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:49.543020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57d3d6-e25c-43f6-bb02-64b41f9709f0 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:49.556635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e75d9-96c8-4840-89b2-76d5b8657a02 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:49.572073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cdae5-f9ba-4dff-8569-40d18d76c789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:49.572985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cdae5-f9ba-4dff-8569-40d18d76c789 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:49.573915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cdae5-f9ba-4dff-8569-40d18d76c789 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:49.574369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cdae5-f9ba-4dff-8569-40d18d76c789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:49.576303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:49.582876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-254cdae5-f9ba-4dff-8569-40d18d76c789 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:49.583064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:49.583064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:49.583064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] PATH_INFO: `/v3/projects/7732758bacc24c6088abfd3bc25ece4f` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:49.583471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7732758bacc24c6088abfd3bc25ece4f)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:49.597177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:49.621792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cdae5-f9ba-4dff-8569-40d18d76c789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:49.623842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cdae5-f9ba-4dff-8569-40d18d76c789 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:49.650539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 882/1736] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:49.883481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7732758bacc24c6088abfd3bc25ece4f', 'request_id': 'req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:49.934967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7732758bacc24c6088abfd3bc25ece4f', 'request_id': 'req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:49.971784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7732758bacc24c6088abfd3bc25ece4f', 'request_id': 'req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:50.042280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] The token cache is being invalidate because project 7732758bacc24c6088abfd3bc25ece4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:50:50.054733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:50.058360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-aab219d6-8d61-4cac-a2c6-79f8e0b15f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:50.066526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 855/1737] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:50:49 2022] DELETE /identity/v3/projects/7732758bacc24c6088abfd3bc25ece4f => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:50.076538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500367b-0ad2-42d4-af41-726b093b24fb None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:50.076538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500367b-0ad2-42d4-af41-726b093b24fb None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:50.076538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500367b-0ad2-42d4-af41-726b093b24fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:50.205510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e500367b-0ad2-42d4-af41-726b093b24fb None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:50.217434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e500367b-0ad2-42d4-af41-726b093b24fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:50.509651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 883/1738] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:50.518968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db154-d75a-445d-b905-6747e57da80c None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:50.519401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db154-d75a-445d-b905-6747e57da80c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:50.519828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db154-d75a-445d-b905-6747e57da80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:50.669910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-597db154-d75a-445d-b905-6747e57da80c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:50.698488 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-597db154-d75a-445d-b905-6747e57da80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:50.860401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500367b-0ad2-42d4-af41-726b093b24fb None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:50.860817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 856/1739] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:50.922580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500367b-0ad2-42d4-af41-726b093b24fb None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:50.979835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f10468-8745-4f5b-bea4-7e066bd2a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:50.981015 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f10468-8745-4f5b-bea4-7e066bd2a00f admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:50.981511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f10468-8745-4f5b-bea4-7e066bd2a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:50.982002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f10468-8745-4f5b-bea4-7e066bd2a00f admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:50.994465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f10468-8745-4f5b-bea4-7e066bd2a00f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:50:50.996610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f10468-8745-4f5b-bea4-7e066bd2a00f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:51.009872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f10468-8745-4f5b-bea4-7e066bd2a00f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:51.128158 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 884/1740] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:50:51.138190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597db154-d75a-445d-b905-6747e57da80c None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:51.175821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597db154-d75a-445d-b905-6747e57da80c None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:51.195571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce21df-e509-4882-b593-c947fa93e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:51.196276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce21df-e509-4882-b593-c947fa93e6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:51.196656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce21df-e509-4882-b593-c947fa93e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:51.196823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce21df-e509-4882-b593-c947fa93e6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:51.199239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce21df-e509-4882-b593-c947fa93e6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:51.204062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce21df-e509-4882-b593-c947fa93e6c1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:51.295472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 857/1741] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:51 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:51.303706 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f10468-8745-4f5b-bea4-7e066bd2a00f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:51.320275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f10468-8745-4f5b-bea4-7e066bd2a00f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:51.397655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:51.588290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbcfe5-a99a-4d89-9e75-f0d2b506410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:51.592059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbcfe5-a99a-4d89-9e75-f0d2b506410d admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:51.592359 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbcfe5-a99a-4d89-9e75-f0d2b506410d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:51.592645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbcfe5-a99a-4d89-9e75-f0d2b506410d admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:51.593372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbcfe5-a99a-4d89-9e75-f0d2b506410d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:51.598657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcbcfe5-a99a-4d89-9e75-f0d2b506410d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:51.687354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 885/1742] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:51 2022] POST /identity/v3/users => generated 283 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:51.691683 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce21df-e509-4882-b593-c947fa93e6c1 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:51.720354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce21df-e509-4882-b593-c947fa93e6c1 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:51.758312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc43e7-89f3-4779-8d3d-115fb1b12864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:51.759376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc43e7-89f3-4779-8d3d-115fb1b12864 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:51.759988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc43e7-89f3-4779-8d3d-115fb1b12864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:51.760501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc43e7-89f3-4779-8d3d-115fb1b12864 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:51.761498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc43e7-89f3-4779-8d3d-115fb1b12864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:51.764460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc43e7-89f3-4779-8d3d-115fb1b12864 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:51.808452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbcfe5-a99a-4d89-9e75-f0d2b506410d admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:51.809021 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 858/1743] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:51.829106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbcfe5-a99a-4d89-9e75-f0d2b506410d admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:51.856596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2dc5c-c9b0-478f-8c75-4818a2bd3bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:51.857591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2dc5c-c9b0-478f-8c75-4818a2bd3bad admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:51.860066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2dc5c-c9b0-478f-8c75-4818a2bd3bad admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:51.860512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2dc5c-c9b0-478f-8c75-4818a2bd3bad admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:51.861462 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2dc5c-c9b0-478f-8c75-4818a2bd3bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:51.869774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2dc5c-c9b0-478f-8c75-4818a2bd3bad admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:51.903171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 886/1744] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:51.904398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc43e7-89f3-4779-8d3d-115fb1b12864 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:51.925031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc43e7-89f3-4779-8d3d-115fb1b12864 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:51.956361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd648b-e97e-41bd-af26-fd36baf10781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:51.958168 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd648b-e97e-41bd-af26-fd36baf10781 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:51.961344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd648b-e97e-41bd-af26-fd36baf10781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:51.961835 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd648b-e97e-41bd-af26-fd36baf10781 admin admin] PATH_INFO: `/v3/projects/d3ff04ab10fd40efbf2ace730edf92d6/users/395c13f21ad44d948473e9ed422a6aed/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:51.974182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:51.992946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd648b-e97e-41bd-af26-fd36baf10781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ff04ab10fd40efbf2ace730edf92d6, user_id=395c13f21ad44d948473e9ed422a6aed, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:51.995811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd648b-e97e-41bd-af26-fd36baf10781 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:52.047215 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 859/1745] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:51 2022] PUT /identity/v3/projects/d3ff04ab10fd40efbf2ace730edf92d6/users/395c13f21ad44d948473e9ed422a6aed/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:50:52.060788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62f97b-cda6-400d-ac36-95b79e069b07 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:52.061386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62f97b-cda6-400d-ac36-95b79e069b07 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:52.062282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62f97b-cda6-400d-ac36-95b79e069b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:52.163936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-0d62f97b-cda6-400d-ac36-95b79e069b07 None None] MFA Rules not processed for user `395c13f21ad44d948473e9ed422a6aed`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:52.170611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0d62f97b-cda6-400d-ac36-95b79e069b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:52.489812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 887/1746] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:52.495483 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd648b-e97e-41bd-af26-fd36baf10781 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:52.800636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd648b-e97e-41bd-af26-fd36baf10781 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:52.849095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d789bc-f7c1-4ef4-94eb-fc423bfd4771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:52.849804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d789bc-f7c1-4ef4-94eb-fc423bfd4771 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:52.850095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d789bc-f7c1-4ef4-94eb-fc423bfd4771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:52.850404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d789bc-f7c1-4ef4-94eb-fc423bfd4771 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:52.855914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d789bc-f7c1-4ef4-94eb-fc423bfd4771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:52.866190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d789bc-f7c1-4ef4-94eb-fc423bfd4771 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:52.967172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 860/1747] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:50:52 2022] POST /identity/v3/projects => generated 365 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:52.968256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62f97b-cda6-400d-ac36-95b79e069b07 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:52.984729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62f97b-cda6-400d-ac36-95b79e069b07 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:53.153060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e37d0-8df8-4914-a3be-30bca8e5b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:53.157566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e37d0-8df8-4914-a3be-30bca8e5b996 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:53.159998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e37d0-8df8-4914-a3be-30bca8e5b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:53.164325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e37d0-8df8-4914-a3be-30bca8e5b996 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:53.168122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e37d0-8df8-4914-a3be-30bca8e5b996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:53.174525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e37d0-8df8-4914-a3be-30bca8e5b996 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:53.246699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 888/1748] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:50:52 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:50:53.251556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d789bc-f7c1-4ef4-94eb-fc423bfd4771 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:53.270753 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d789bc-f7c1-4ef4-94eb-fc423bfd4771 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:53.291411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38dadf-d6f9-44b8-8890-47d88496363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:53.296205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38dadf-d6f9-44b8-8890-47d88496363c admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:53.299360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38dadf-d6f9-44b8-8890-47d88496363c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:53.300551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38dadf-d6f9-44b8-8890-47d88496363c admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:53.305020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38dadf-d6f9-44b8-8890-47d88496363c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:53.314224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38dadf-d6f9-44b8-8890-47d88496363c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:53.377651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e37d0-8df8-4914-a3be-30bca8e5b996 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:53.378997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 861/1749] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:53.409502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e37d0-8df8-4914-a3be-30bca8e5b996 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:53.431258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ed34-68e9-477c-8d31-95c287beba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:53.433156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ed34-68e9-477c-8d31-95c287beba82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:53.435312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ed34-68e9-477c-8d31-95c287beba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:53.438025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ed34-68e9-477c-8d31-95c287beba82 admin admin] PATH_INFO: `/v3/projects/f65cf9fde5be4ae4a5f9046b8058be5e/users/20afeea690bc42b69dcb62eb168730bc/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:53.479454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:53.486988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3ed34-68e9-477c-8d31-95c287beba82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65cf9fde5be4ae4a5f9046b8058be5e, user_id=20afeea690bc42b69dcb62eb168730bc, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:53.502052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3ed34-68e9-477c-8d31-95c287beba82 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:53.538065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 889/1750] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:53 2022] PUT /identity/v3/projects/f65cf9fde5be4ae4a5f9046b8058be5e/users/20afeea690bc42b69dcb62eb168730bc/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:50:53.545706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38dadf-d6f9-44b8-8890-47d88496363c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:53.560285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38dadf-d6f9-44b8-8890-47d88496363c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:53.813564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6899-37b9-4021-a897-1b40103cdd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:53.814339 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6899-37b9-4021-a897-1b40103cdd16 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:53.814694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6899-37b9-4021-a897-1b40103cdd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:53.815055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6899-37b9-4021-a897-1b40103cdd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:53.816050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6899-37b9-4021-a897-1b40103cdd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:53.817747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6899-37b9-4021-a897-1b40103cdd16 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:53.838575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ed34-68e9-477c-8d31-95c287beba82 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:53.841021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3da3ed34-68e9-477c-8d31-95c287beba82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:53.859124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ed34-68e9-477c-8d31-95c287beba82 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:53.865872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:53.867043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:53.867518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:53.867933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] PATH_INFO: `/v3/users/1b00f9912dae497aa5151ed9afd03ffa` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:53.869421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b00f9912dae497aa5151ed9afd03ffa)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:53.872151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:53.877436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 862/1751] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:50:53.882112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6899-37b9-4021-a897-1b40103cdd16 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:53.908194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6899-37b9-4021-a897-1b40103cdd16 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:53.927345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b030f27-e9e0-40a5-b89b-769e54673646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:53.931784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b030f27-e9e0-40a5-b89b-769e54673646 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:53.933802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b030f27-e9e0-40a5-b89b-769e54673646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:53.934149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b030f27-e9e0-40a5-b89b-769e54673646 admin admin] PATH_INFO: `/v3/projects/f65cf9fde5be4ae4a5f9046b8058be5e/users/20afeea690bc42b69dcb62eb168730bc/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:53.937579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b030f27-e9e0-40a5-b89b-769e54673646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65cf9fde5be4ae4a5f9046b8058be5e, user_id=20afeea690bc42b69dcb62eb168730bc, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:53.944151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b030f27-e9e0-40a5-b89b-769e54673646 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:53.956557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b00f9912dae497aa5151ed9afd03ffa'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:53.973283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 863/1752] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:50:53 2022] PUT /identity/v3/projects/f65cf9fde5be4ae4a5f9046b8058be5e/users/20afeea690bc42b69dcb62eb168730bc/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:53.979102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b00f9912dae497aa5151ed9afd03ffa'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:53.984569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae034-2214-4930-9fbc-91285feb3720 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:53.984937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae034-2214-4930-9fbc-91285feb3720 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:53.985715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae034-2214-4930-9fbc-91285feb3720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:53.987477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b00f9912dae497aa5151ed9afd03ffa'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:54.024184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b00f9912dae497aa5151ed9afd03ffa'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:54.050715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1431402c-fe72-4466-b942-2ec313ea8ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b00f9912dae497aa5151ed9afd03ffa'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:54.071286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 890/1753] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:50:53 2022] DELETE /identity/v3/users/1b00f9912dae497aa5151ed9afd03ffa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:54.075570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cf899-d5bc-4249-bac8-c00d253edd1c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:54.075880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cf899-d5bc-4249-bac8-c00d253edd1c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:54.076161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cf899-d5bc-4249-bac8-c00d253edd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:54.108670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d12ae034-2214-4930-9fbc-91285feb3720 None None] MFA Rules not processed for user `20afeea690bc42b69dcb62eb168730bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:54.117579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d12ae034-2214-4930-9fbc-91285feb3720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:54.154523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-576cf899-d5bc-4249-bac8-c00d253edd1c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:54.155878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-576cf899-d5bc-4249-bac8-c00d253edd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:54.296636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:54.368687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 864/1754] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:50:54.372341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ae7b-ffaf-4e3b-ab04-0b85b3184b64 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:54.373195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ae7b-ffaf-4e3b-ab04-0b85b3184b64 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:54.373715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ae7b-ffaf-4e3b-ab04-0b85b3184b64 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:54.375520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 865/1755] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:50:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:50:54.382722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ae7b-ffaf-4e3b-ab04-0b85b3184b64 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:54.384654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f650ae7b-ffaf-4e3b-ab04-0b85b3184b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:54.431375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 891/1756] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:50:54.446988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7b234-f37b-457a-ba0b-badfea59ae36 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:54.447558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7b234-f37b-457a-ba0b-badfea59ae36 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:54.448018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7b234-f37b-457a-ba0b-badfea59ae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:54.522847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-05e7b234-f37b-457a-ba0b-badfea59ae36 None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:54.524115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-05e7b234-f37b-457a-ba0b-badfea59ae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:54.658006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ae7b-ffaf-4e3b-ab04-0b85b3184b64 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:54.674645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd73bbf-2598-4655-817f-bf0c9f8a85ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:54.674645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73bbf-2598-4655-817f-bf0c9f8a85ed service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:54.674645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73bbf-2598-4655-817f-bf0c9f8a85ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:54.674645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73bbf-2598-4655-817f-bf0c9f8a85ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:54.723045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:54.725540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd73bbf-2598-4655-817f-bf0c9f8a85ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:54.727170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd73bbf-2598-4655-817f-bf0c9f8a85ed service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:54.759975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 866/1757] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:50:54.763479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd73bbf-2598-4655-817f-bf0c9f8a85ed service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:54.767428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4cd73bbf-2598-4655-817f-bf0c9f8a85ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:54.829189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 892/1758] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:50:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:50:54.903142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd73bbf-2598-4655-817f-bf0c9f8a85ed service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:54.908411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827d14e-98f8-4930-80b2-fd8e518851c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:54.909683 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827d14e-98f8-4930-80b2-fd8e518851c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:54.910087 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827d14e-98f8-4930-80b2-fd8e518851c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:54.910527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827d14e-98f8-4930-80b2-fd8e518851c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:54.936261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827d14e-98f8-4930-80b2-fd8e518851c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:54.939410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827d14e-98f8-4930-80b2-fd8e518851c7 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:54.962723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 867/1759] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:54.967461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7b234-f37b-457a-ba0b-badfea59ae36 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:55.004043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7b234-f37b-457a-ba0b-badfea59ae36 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:55.031426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:55.034144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:55.037662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:55.040949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:55.053931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:55.372478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:55.383537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:55.466872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 893/1760] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:56.039118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827d14e-98f8-4930-80b2-fd8e518851c7 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:56.040583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6827d14e-98f8-4930-80b2-fd8e518851c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:56.069351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827d14e-98f8-4930-80b2-fd8e518851c7 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:56.099147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3c1d8-dfa6-4814-95e1-b19e2d02321f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:56.099841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3c1d8-dfa6-4814-95e1-b19e2d02321f service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:56.100130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3c1d8-dfa6-4814-95e1-b19e2d02321f service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:56.100495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3c1d8-dfa6-4814-95e1-b19e2d02321f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:56.136549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3c1d8-dfa6-4814-95e1-b19e2d02321f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:56.143537 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3c1d8-dfa6-4814-95e1-b19e2d02321f service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:56.171668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 868/1761] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:50:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:50:59.155918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:59.157567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:59.200673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d4880-e1ca-4d59-89e1-e292d768096d service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:50:59.221548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:50:59.222510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:59.222821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:59.240050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] PATH_INFO: `/v3/users/395c13f21ad44d948473e9ed422a6aed` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:59.241903 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395c13f21ad44d948473e9ed422a6aed)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:50:59.257377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:50:59.479959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395c13f21ad44d948473e9ed422a6aed'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:59.553950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395c13f21ad44d948473e9ed422a6aed'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:59.560862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395c13f21ad44d948473e9ed422a6aed'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:59.583230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395c13f21ad44d948473e9ed422a6aed'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:59.597327 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395c13f21ad44d948473e9ed422a6aed'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:50:59.616171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 894/1762] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:50:59 2022] DELETE /identity/v3/users/395c13f21ad44d948473e9ed422a6aed => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:50:59.623495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091308d-4b42-445e-9564-03b6c5e1c801 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:50:59.624957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091308d-4b42-445e-9564-03b6c5e1c801 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:50:59.625885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091308d-4b42-445e-9564-03b6c5e1c801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:50:59.690014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:50:59.694958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:59.711854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a091308d-4b42-445e-9564-03b6c5e1c801 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:50:59.718442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a091308d-4b42-445e-9564-03b6c5e1c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:50:59.991228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 869/1763] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:00.069611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c391-d36e-44a9-beb1-5c7645603762 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:00.082293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:00.083679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:00.084076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:00.084461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] PATH_INFO: `/v3/projects/ab3aa3d053fd4cb3b1dbbdd0931e9c14` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:00.086000 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3aa3d053fd4cb3b1dbbdd0931e9c14)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:00.088887 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:00.099370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:00.120425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091308d-4b42-445e-9564-03b6c5e1c801 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:00.122113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a091308d-4b42-445e-9564-03b6c5e1c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:00.128944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:00.180341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3aa3d053fd4cb3b1dbbdd0931e9c14', 'request_id': 'req-6bb4287e-618b-448e-a351-26801ffa3aa9'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.191371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3aa3d053fd4cb3b1dbbdd0931e9c14', 'request_id': 'req-6bb4287e-618b-448e-a351-26801ffa3aa9'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.225672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3aa3d053fd4cb3b1dbbdd0931e9c14', 'request_id': 'req-6bb4287e-618b-448e-a351-26801ffa3aa9'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.251916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091308d-4b42-445e-9564-03b6c5e1c801 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:00.252490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] The token cache is being invalidate because project ab3aa3d053fd4cb3b1dbbdd0931e9c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:00.252945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.254775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.257158 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 895/1764] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:50:59 2022] DELETE /identity/v3/projects/ab3aa3d053fd4cb3b1dbbdd0931e9c14 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:00.265119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:00.268373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:00.360914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:00.361732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:00.361888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:00.362349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:00.364475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:00.448786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:00.449981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:00.464123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 870/1765] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:00.481730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4287e-618b-448e-a351-26801ffa3aa9 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:00.487407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:00.488320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:00.488601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:00.488877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] PATH_INFO: `/v3/users/4370e2b115a747bb865152a8fac6f678` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:00.490223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4370e2b115a747bb865152a8fac6f678)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:00.492412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:00.581669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4370e2b115a747bb865152a8fac6f678'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.597982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4370e2b115a747bb865152a8fac6f678'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.598803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4370e2b115a747bb865152a8fac6f678'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.607806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4370e2b115a747bb865152a8fac6f678'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.621765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92f6e63e-7460-44c7-bf0d-45642a25e855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4370e2b115a747bb865152a8fac6f678'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.625372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:00.627966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:00.631490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 896/1766] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:00 2022] DELETE /identity/v3/users/4370e2b115a747bb865152a8fac6f678 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:00.660004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c2c46-ab60-40bd-95e6-a3833162015c service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:00.741484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:00.742750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:00.743027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:00.743464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] PATH_INFO: `/v3/users/73bd01db605349b089fb01e0711b89ab` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:00.745516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bd01db605349b089fb01e0711b89ab)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:00.747904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:00.763020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:00.824148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bd01db605349b089fb01e0711b89ab'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.841913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bd01db605349b089fb01e0711b89ab'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.843091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bd01db605349b089fb01e0711b89ab'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.899079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bd01db605349b089fb01e0711b89ab'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.922577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bd01db605349b089fb01e0711b89ab'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:00.936626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 871/1767] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:00 2022] DELETE /identity/v3/users/73bd01db605349b089fb01e0711b89ab => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:00.942572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d8734-e7df-4947-9b81-508d85b19f8d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:00.943026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d8734-e7df-4947-9b81-508d85b19f8d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:00.944052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d8734-e7df-4947-9b81-508d85b19f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:00.978485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ef8d8734-e7df-4947-9b81-508d85b19f8d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:00.980814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ef8d8734-e7df-4947-9b81-508d85b19f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:01.014220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:01.142530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 897/1768] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:01.199925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:01.201534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:01.333837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8526675-cfdb-4922-8c16-893a924d7fb8 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:01.344228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5f9d3-ec10-40fa-bc3e-2a6b9fa17299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:01.344914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5f9d3-ec10-40fa-bc3e-2a6b9fa17299 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:01.345202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5f9d3-ec10-40fa-bc3e-2a6b9fa17299 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:01.345478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5f9d3-ec10-40fa-bc3e-2a6b9fa17299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:01.368481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5f9d3-ec10-40fa-bc3e-2a6b9fa17299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:01.370722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5f9d3-ec10-40fa-bc3e-2a6b9fa17299 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:01.405210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 872/1769] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:01.890527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d8734-e7df-4947-9b81-508d85b19f8d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:01.893167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ef8d8734-e7df-4947-9b81-508d85b19f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:01.910116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d8734-e7df-4947-9b81-508d85b19f8d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:01.916004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:01.917874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:01.918598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:01.919163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] PATH_INFO: `/v3/projects/19f27087e327459e8e84fdaf06388cbf` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:01.921106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f27087e327459e8e84fdaf06388cbf)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:01.924049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:01.998958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f27087e327459e8e84fdaf06388cbf', 'request_id': 'req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.012944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f27087e327459e8e84fdaf06388cbf', 'request_id': 'req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.030953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f27087e327459e8e84fdaf06388cbf', 'request_id': 'req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.061119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] The token cache is being invalidate because project 19f27087e327459e8e84fdaf06388cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:02.061856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.063134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.065625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 898/1770] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:01 2022] DELETE /identity/v3/projects/19f27087e327459e8e84fdaf06388cbf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:02.070876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319ceb0-fad9-4888-8ada-4de45db8aaef None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:02.071744 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319ceb0-fad9-4888-8ada-4de45db8aaef None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:02.072201 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319ceb0-fad9-4888-8ada-4de45db8aaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:02.089182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:02.090737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:02.092354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-0319ceb0-fad9-4888-8ada-4de45db8aaef None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:02.093542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0319ceb0-fad9-4888-8ada-4de45db8aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:02.213292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a8f27-7866-40d3-a230-4c29e2f6fd9e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:02.225628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:02.226674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:02.226967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:02.227235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] PATH_INFO: `/v3/projects/d3ff04ab10fd40efbf2ace730edf92d6` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:02.234047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ff04ab10fd40efbf2ace730edf92d6)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:02.236070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:02.240349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 873/1771] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:02.241381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319ceb0-fad9-4888-8ada-4de45db8aaef None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:02.250775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0319ceb0-fad9-4888-8ada-4de45db8aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:02.287053 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319ceb0-fad9-4888-8ada-4de45db8aaef None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:02.295436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:02.296438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:02.296793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:02.297338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] PATH_INFO: `/v3/projects/20e129812a3e4e2e8a0e3b5af697b959` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:02.298734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e129812a3e4e2e8a0e3b5af697b959)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:02.300998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:02.330102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:02.345225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ff04ab10fd40efbf2ace730edf92d6', 'request_id': 'req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.354803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ff04ab10fd40efbf2ace730edf92d6', 'request_id': 'req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.355858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:02.370528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ff04ab10fd40efbf2ace730edf92d6', 'request_id': 'req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.387749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e129812a3e4e2e8a0e3b5af697b959', 'request_id': 'req-30b330f9-e211-42a1-96ad-d6bb07134670'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.388352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] The token cache is being invalidate because project d3ff04ab10fd40efbf2ace730edf92d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:02.388881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.391249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3b96e5be-fa9e-46fd-86de-f3d7646e0c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.394678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 899/1772] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:02 2022] DELETE /identity/v3/projects/d3ff04ab10fd40efbf2ace730edf92d6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:02.396405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3318-94c2-49ed-84da-dffcdf91fa7f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:02.396928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3318-94c2-49ed-84da-dffcdf91fa7f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:02.397535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3318-94c2-49ed-84da-dffcdf91fa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:02.403649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e129812a3e4e2e8a0e3b5af697b959', 'request_id': 'req-30b330f9-e211-42a1-96ad-d6bb07134670'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.418122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e129812a3e4e2e8a0e3b5af697b959', 'request_id': 'req-30b330f9-e211-42a1-96ad-d6bb07134670'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.425698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-db3a3318-94c2-49ed-84da-dffcdf91fa7f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:02.427734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-db3a3318-94c2-49ed-84da-dffcdf91fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:02.438242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] The token cache is being invalidate because project 20e129812a3e4e2e8a0e3b5af697b959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:02.438662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.439432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.445656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 874/1773] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:02 2022] DELETE /identity/v3/projects/20e129812a3e4e2e8a0e3b5af697b959 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:02.447525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:02.449136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:02.547748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 900/1774] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:02.550041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a3318-94c2-49ed-84da-dffcdf91fa7f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:02.551720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-db3a3318-94c2-49ed-84da-dffcdf91fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:02.576862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a3318-94c2-49ed-84da-dffcdf91fa7f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:02.589855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b330f9-e211-42a1-96ad-d6bb07134670 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:02.598368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:02.600287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:02.601281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:02.602285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:02.602698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:02.602858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:02.603277 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] PATH_INFO: `/v3/users/20afeea690bc42b69dcb62eb168730bc` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:02.604237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] PATH_INFO: `/v3/users/a586ad7670bd4ba38d53c26da98245f1` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:02.606232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20afeea690bc42b69dcb62eb168730bc)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:02.607213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a586ad7670bd4ba38d53c26da98245f1)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:02.609979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:02.611538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:02.711690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20afeea690bc42b69dcb62eb168730bc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.720287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a586ad7670bd4ba38d53c26da98245f1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.747207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20afeea690bc42b69dcb62eb168730bc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.748326 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20afeea690bc42b69dcb62eb168730bc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.755091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a586ad7670bd4ba38d53c26da98245f1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.756539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a586ad7670bd4ba38d53c26da98245f1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.771773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20afeea690bc42b69dcb62eb168730bc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.776279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a586ad7670bd4ba38d53c26da98245f1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.794276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20afeea690bc42b69dcb62eb168730bc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.804975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 875/1775] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:02 2022] DELETE /identity/v3/users/20afeea690bc42b69dcb62eb168730bc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:02.808284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-94518116-180c-411b-b7f8-0124355b1346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a586ad7670bd4ba38d53c26da98245f1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:02.813501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:02.822355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 901/1776] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:02 2022] DELETE /identity/v3/users/a586ad7670bd4ba38d53c26da98245f1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:02.825098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:02.827583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec26f1-d846-4535-a8f0-94e0aae164f8 None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:02.828439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec26f1-d846-4535-a8f0-94e0aae164f8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:02.829182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec26f1-d846-4535-a8f0-94e0aae164f8 None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:02.832152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 902/1777] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:51:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:02.894886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:02.897890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b65e59-bf38-4940-9fb8-4da11c0c268c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:02.898635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b65e59-bf38-4940-9fb8-4da11c0c268c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:02.898635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b65e59-bf38-4940-9fb8-4da11c0c268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:02.944096 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-17b65e59-bf38-4940-9fb8-4da11c0c268c None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:02.950273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-17b65e59-bf38-4940-9fb8-4da11c0c268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:02.979944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f515-2cec-4120-a62f-d25ea6591908 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:03.032208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:03.082021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 903/1778] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:51:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:03.126911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81746-9131-4e24-9e26-4722f1a45d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:03.128145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81746-9131-4e24-9e26-4722f1a45d13 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:03.128901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81746-9131-4e24-9e26-4722f1a45d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:03.129783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81746-9131-4e24-9e26-4722f1a45d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:03.131827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b81746-9131-4e24-9e26-4722f1a45d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:03.132183 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b81746-9131-4e24-9e26-4722f1a45d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:03.137276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b81746-9131-4e24-9e26-4722f1a45d13 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:03.163759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 876/1779] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:03.171098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b65e59-bf38-4940-9fb8-4da11c0c268c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:03.173361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-17b65e59-bf38-4940-9fb8-4da11c0c268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:03.193139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b65e59-bf38-4940-9fb8-4da11c0c268c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:03.203044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b02f3-9ba8-45f4-b5fb-38e1a3c3f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:03.204568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b02f3-9ba8-45f4-b5fb-38e1a3c3f897 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:03.205110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b02f3-9ba8-45f4-b5fb-38e1a3c3f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:03.207392 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b02f3-9ba8-45f4-b5fb-38e1a3c3f897 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:03.208953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b02f3-9ba8-45f4-b5fb-38e1a3c3f897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:03.213032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b02f3-9ba8-45f4-b5fb-38e1a3c3f897 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:03.259751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 904/1780] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:03 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:03.266412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81746-9131-4e24-9e26-4722f1a45d13 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:03.277575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81746-9131-4e24-9e26-4722f1a45d13 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:03.373069 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42775d-b5aa-4135-a378-7e9863c8e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:03.374243 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42775d-b5aa-4135-a378-7e9863c8e85e admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:03.375764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42775d-b5aa-4135-a378-7e9863c8e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:03.376167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42775d-b5aa-4135-a378-7e9863c8e85e admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:03.377287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42775d-b5aa-4135-a378-7e9863c8e85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:03.379524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42775d-b5aa-4135-a378-7e9863c8e85e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:03.412559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 877/1781] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:03 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:03.413969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b02f3-9ba8-45f4-b5fb-38e1a3c3f897 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:03.430547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b02f3-9ba8-45f4-b5fb-38e1a3c3f897 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:03.437445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886f126-6e4f-4593-96f7-43dc0604ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:03.438307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886f126-6e4f-4593-96f7-43dc0604ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:03.438730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886f126-6e4f-4593-96f7-43dc0604ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:03.439153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886f126-6e4f-4593-96f7-43dc0604ca7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:03.440048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886f126-6e4f-4593-96f7-43dc0604ca7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:03.442207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886f126-6e4f-4593-96f7-43dc0604ca7f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:03.464790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 905/1782] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:03.467278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42775d-b5aa-4135-a378-7e9863c8e85e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:03.493078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42775d-b5aa-4135-a378-7e9863c8e85e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:03.509951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c2bd1-bdfe-4987-b85a-08684462aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:03.511049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c2bd1-bdfe-4987-b85a-08684462aa0c admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:03.511787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c2bd1-bdfe-4987-b85a-08684462aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:03.511787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c2bd1-bdfe-4987-b85a-08684462aa0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:03.512803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c2bd1-bdfe-4987-b85a-08684462aa0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:03.514854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c2bd1-bdfe-4987-b85a-08684462aa0c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:03.531381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 878/1783] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:03.532592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886f126-6e4f-4593-96f7-43dc0604ca7f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:03.546507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886f126-6e4f-4593-96f7-43dc0604ca7f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:03.551783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b796b78-e852-4a08-b73c-e3c0ffe0648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:03.552857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b796b78-e852-4a08-b73c-e3c0ffe0648a admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:03.553148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b796b78-e852-4a08-b73c-e3c0ffe0648a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:03.553427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b796b78-e852-4a08-b73c-e3c0ffe0648a admin admin] PATH_INFO: `/v3/projects/9fac4cdfc72c46bdaaa44e8d28cc26b9/users/f3cd5287280a41b6bd1b89df4cb3a94c/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:03.572187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b796b78-e852-4a08-b73c-e3c0ffe0648a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fac4cdfc72c46bdaaa44e8d28cc26b9, user_id=f3cd5287280a41b6bd1b89df4cb3a94c, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:03.574695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b796b78-e852-4a08-b73c-e3c0ffe0648a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:03.601834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 906/1784] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:03 2022] PUT /identity/v3/projects/9fac4cdfc72c46bdaaa44e8d28cc26b9/users/f3cd5287280a41b6bd1b89df4cb3a94c/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:03.604293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60f08-3fe4-4cf7-b620-555c7cf32126 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:03.604697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60f08-3fe4-4cf7-b620-555c7cf32126 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:03.605074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60f08-3fe4-4cf7-b620-555c7cf32126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:03.643761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-26e60f08-3fe4-4cf7-b620-555c7cf32126 None None] MFA Rules not processed for user `f3cd5287280a41b6bd1b89df4cb3a94c`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:03.645178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-26e60f08-3fe4-4cf7-b620-555c7cf32126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:03.697130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:03.727548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 879/1785] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:03.734781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b796b78-e852-4a08-b73c-e3c0ffe0648a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:03.890559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b796b78-e852-4a08-b73c-e3c0ffe0648a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:03.895659 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0429019-70f6-4a6d-af9b-d11be462edb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:03.896424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0429019-70f6-4a6d-af9b-d11be462edb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:03.896951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0429019-70f6-4a6d-af9b-d11be462edb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:03.897450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0429019-70f6-4a6d-af9b-d11be462edb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:03.898216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0429019-70f6-4a6d-af9b-d11be462edb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:03.901031 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0429019-70f6-4a6d-af9b-d11be462edb2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:03.945895 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60f08-3fe4-4cf7-b620-555c7cf32126 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:03.953967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 907/1786] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:03 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:03.976476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60f08-3fe4-4cf7-b620-555c7cf32126 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:04.050254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0429019-70f6-4a6d-af9b-d11be462edb2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:04.055699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d0429019-70f6-4a6d-af9b-d11be462edb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:04.145077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afaa67-d52c-4982-9d85-20853c76238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:04.145936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afaa67-d52c-4982-9d85-20853c76238f admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:04.146083 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afaa67-d52c-4982-9d85-20853c76238f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:04.146459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afaa67-d52c-4982-9d85-20853c76238f admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:04.147605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afaa67-d52c-4982-9d85-20853c76238f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:04.149198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afaa67-d52c-4982-9d85-20853c76238f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:04.176759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 880/1787] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:03 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:04.183964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afaa67-d52c-4982-9d85-20853c76238f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:04.197217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afaa67-d52c-4982-9d85-20853c76238f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:04.214231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada2f46-0a5d-484c-9584-4197eab0e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:04.217054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada2f46-0a5d-484c-9584-4197eab0e235 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:04.217363 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada2f46-0a5d-484c-9584-4197eab0e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:04.217653 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada2f46-0a5d-484c-9584-4197eab0e235 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:04.218522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada2f46-0a5d-484c-9584-4197eab0e235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:04.221505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada2f46-0a5d-484c-9584-4197eab0e235 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:04.244105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 881/1788] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:04.249614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada2f46-0a5d-484c-9584-4197eab0e235 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:04.278425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada2f46-0a5d-484c-9584-4197eab0e235 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:04.289795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849ce40-78f7-48f5-8f5c-0ff8f610c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:04.290656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:04.292338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849ce40-78f7-48f5-8f5c-0ff8f610c352 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:04.292936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849ce40-78f7-48f5-8f5c-0ff8f610c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:04.293545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849ce40-78f7-48f5-8f5c-0ff8f610c352 admin admin] PATH_INFO: `/v3/projects/1db25581591343b9acc7a83c4ed9b2c5/users/9a8834a779e74081811cca2bd9c22259/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:04.319486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0429019-70f6-4a6d-af9b-d11be462edb2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:04.333294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe0c89-0882-4a64-8c1f-0f4ef6c435e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:04.333970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0c89-0882-4a64-8c1f-0f4ef6c435e1 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:04.334255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0c89-0882-4a64-8c1f-0f4ef6c435e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:04.334584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0c89-0882-4a64-8c1f-0f4ef6c435e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:04.336221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849ce40-78f7-48f5-8f5c-0ff8f610c352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db25581591343b9acc7a83c4ed9b2c5, user_id=9a8834a779e74081811cca2bd9c22259, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:04.342492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849ce40-78f7-48f5-8f5c-0ff8f610c352 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:04.351392 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe0c89-0882-4a64-8c1f-0f4ef6c435e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:04.355277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe0c89-0882-4a64-8c1f-0f4ef6c435e1 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:04.379352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 882/1789] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:04 2022] PUT /identity/v3/projects/1db25581591343b9acc7a83c4ed9b2c5/users/9a8834a779e74081811cca2bd9c22259/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:04.381218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849ce40-78f7-48f5-8f5c-0ff8f610c352 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:04.385199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8849ce40-78f7-48f5-8f5c-0ff8f610c352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:04.396372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 908/1790] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:04.397380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe0c89-0882-4a64-8c1f-0f4ef6c435e1 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:04.455897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe0c89-0882-4a64-8c1f-0f4ef6c435e1 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:04.615700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849ce40-78f7-48f5-8f5c-0ff8f610c352 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:04.631263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:04.633228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:04.633960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:04.634681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] PATH_INFO: `/v3/projects/f65cf9fde5be4ae4a5f9046b8058be5e` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:04.637972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65cf9fde5be4ae4a5f9046b8058be5e)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:04.642913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:04.664606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac06c7-96fb-4305-a6ad-e7a0e3fc63c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:04.665472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac06c7-96fb-4305-a6ad-e7a0e3fc63c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:04.665686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac06c7-96fb-4305-a6ad-e7a0e3fc63c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:04.674433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac06c7-96fb-4305-a6ad-e7a0e3fc63c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:04.675232 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac06c7-96fb-4305-a6ad-e7a0e3fc63c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:04.679222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac06c7-96fb-4305-a6ad-e7a0e3fc63c1 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:04.755360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 909/1791] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:04.758859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac06c7-96fb-4305-a6ad-e7a0e3fc63c1 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:04.771988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:04.776523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7cac06c7-96fb-4305-a6ad-e7a0e3fc63c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:04.797924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65cf9fde5be4ae4a5f9046b8058be5e', 'request_id': 'req-86425d9b-3106-4994-bbea-307b998182ba'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:04.823000 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac06c7-96fb-4305-a6ad-e7a0e3fc63c1 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:04.840624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65cf9fde5be4ae4a5f9046b8058be5e', 'request_id': 'req-86425d9b-3106-4994-bbea-307b998182ba'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:04.861513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65cf9fde5be4ae4a5f9046b8058be5e', 'request_id': 'req-86425d9b-3106-4994-bbea-307b998182ba'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:04.889248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] The token cache is being invalidate because project f65cf9fde5be4ae4a5f9046b8058be5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:04.889913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:04.892219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:04.896917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 883/1792] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:04 2022] DELETE /identity/v3/projects/f65cf9fde5be4ae4a5f9046b8058be5e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:04.897964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:04.902280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:04.969632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:04.971260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:04.971780 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:04.972790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] PATH_INFO: `/v3/projects/8efbd4ab95a948388f74636a616a5eca` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:04.977144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efbd4ab95a948388f74636a616a5eca)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:04.982749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:05.016160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86425d9b-3106-4994-bbea-307b998182ba admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:05.021859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23dce4-754f-4778-9071-429dc8068d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:05.023149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23dce4-754f-4778-9071-429dc8068d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.023581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23dce4-754f-4778-9071-429dc8068d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.025163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23dce4-754f-4778-9071-429dc8068d0d admin admin] PATH_INFO: `/v3/projects/1db25581591343b9acc7a83c4ed9b2c5/users/9a8834a779e74081811cca2bd9c22259/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.037329 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23dce4-754f-4778-9071-429dc8068d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db25581591343b9acc7a83c4ed9b2c5, user_id=9a8834a779e74081811cca2bd9c22259, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:05.046164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23dce4-754f-4778-9071-429dc8068d0d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:05.067366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efbd4ab95a948388f74636a616a5eca', 'request_id': 'req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:05.074787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 884/1793] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:04 2022] PUT /identity/v3/projects/1db25581591343b9acc7a83c4ed9b2c5/users/9a8834a779e74081811cca2bd9c22259/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:05.075721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efbd4ab95a948388f74636a616a5eca', 'request_id': 'req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:05.079229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af8bdc-846d-470b-81ac-3ee7ba5894c7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.080244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af8bdc-846d-470b-81ac-3ee7ba5894c7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.080827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af8bdc-846d-470b-81ac-3ee7ba5894c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.086918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efbd4ab95a948388f74636a616a5eca', 'request_id': 'req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:05.104018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] The token cache is being invalidate because project 8efbd4ab95a948388f74636a616a5eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:05.104263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:05.105219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-68414a7e-85bf-433f-9b46-2f2ea82bcb3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:05.107474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 910/1794] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:04 2022] DELETE /identity/v3/projects/8efbd4ab95a948388f74636a616a5eca => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:05.111835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75738a0-3ab5-46f5-aa7f-27fdf4e43152 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.112418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75738a0-3ab5-46f5-aa7f-27fdf4e43152 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.113425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75738a0-3ab5-46f5-aa7f-27fdf4e43152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.116340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-98af8bdc-846d-470b-81ac-3ee7ba5894c7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:05.118500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-98af8bdc-846d-470b-81ac-3ee7ba5894c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:05.185905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:05.193629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-f75738a0-3ab5-46f5-aa7f-27fdf4e43152 None None] MFA Rules not processed for user `9a8834a779e74081811cca2bd9c22259`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:05.195080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f75738a0-3ab5-46f5-aa7f-27fdf4e43152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:05.275527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 885/1795] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:05.277590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759668-99a3-4645-a63b-885508ae505b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.278335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759668-99a3-4645-a63b-885508ae505b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.279221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f759668-99a3-4645-a63b-885508ae505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.308156 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-1f759668-99a3-4645-a63b-885508ae505b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:05.309644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1f759668-99a3-4645-a63b-885508ae505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:05.337411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 886/1796] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:05.339519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63128eb5-116a-4f53-a092-5b5bbbfeec10 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.339812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63128eb5-116a-4f53-a092-5b5bbbfeec10 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.340137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63128eb5-116a-4f53-a092-5b5bbbfeec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.377213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-63128eb5-116a-4f53-a092-5b5bbbfeec10 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:05.379011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-63128eb5-116a-4f53-a092-5b5bbbfeec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:05.393188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 887/1797] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:05.395481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b0c67-ff48-4f7b-a4ad-b19cd8e15fa7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.396329 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b0c67-ff48-4f7b-a4ad-b19cd8e15fa7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.396849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b0c67-ff48-4f7b-a4ad-b19cd8e15fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.410433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 911/1798] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:05.411582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75738a0-3ab5-46f5-aa7f-27fdf4e43152 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:05.437685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-079b0c67-ff48-4f7b-a4ad-b19cd8e15fa7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:05.438828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75738a0-3ab5-46f5-aa7f-27fdf4e43152 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:05.439992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-079b0c67-ff48-4f7b-a4ad-b19cd8e15fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:05.448204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50548d-b304-4e56-8d8f-1455495d8c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:05.449099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50548d-b304-4e56-8d8f-1455495d8c55 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.449491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50548d-b304-4e56-8d8f-1455495d8c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.449871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50548d-b304-4e56-8d8f-1455495d8c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.450762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50548d-b304-4e56-8d8f-1455495d8c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:05.451179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50548d-b304-4e56-8d8f-1455495d8c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:05.453625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50548d-b304-4e56-8d8f-1455495d8c55 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:05.460383 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 888/1799] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:05.462628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b0c67-ff48-4f7b-a4ad-b19cd8e15fa7 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:05.468315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-079b0c67-ff48-4f7b-a4ad-b19cd8e15fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:05.477822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 912/1800] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:05.479659 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50548d-b304-4e56-8d8f-1455495d8c55 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:05.495115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50548d-b304-4e56-8d8f-1455495d8c55 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:05.501616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6311d3-78df-4b02-b918-72190773c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:05.503312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6311d3-78df-4b02-b918-72190773c0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.504228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6311d3-78df-4b02-b918-72190773c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.506589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6311d3-78df-4b02-b918-72190773c0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.507750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6311d3-78df-4b02-b918-72190773c0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:05.508202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6311d3-78df-4b02-b918-72190773c0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:05.511718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6311d3-78df-4b02-b918-72190773c0b4 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:05.536038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 913/1801] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:05.536038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6311d3-78df-4b02-b918-72190773c0b4 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:05.573737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6311d3-78df-4b02-b918-72190773c0b4 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:05.586056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28302fa5-80fc-4eb3-a985-057118f7b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:05.587651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28302fa5-80fc-4eb3-a985-057118f7b81b admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.588188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28302fa5-80fc-4eb3-a985-057118f7b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.589340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28302fa5-80fc-4eb3-a985-057118f7b81b admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.591044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28302fa5-80fc-4eb3-a985-057118f7b81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:05.598663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28302fa5-80fc-4eb3-a985-057118f7b81b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:05.630788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:05.671351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 914/1802] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:05.673082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28302fa5-80fc-4eb3-a985-057118f7b81b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:05.673253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b0c67-ff48-4f7b-a4ad-b19cd8e15fa7 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:05.792119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171a61c-5a63-4f4d-9ec8-98fe36ec1776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:05.792784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171a61c-5a63-4f4d-9ec8-98fe36ec1776 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.793214 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171a61c-5a63-4f4d-9ec8-98fe36ec1776 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.793596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171a61c-5a63-4f4d-9ec8-98fe36ec1776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.795229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28302fa5-80fc-4eb3-a985-057118f7b81b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:05.795560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c171a61c-5a63-4f4d-9ec8-98fe36ec1776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:05.802015 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5342d-2aa8-4817-bbc8-a661fce702b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:05.803233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5342d-2aa8-4817-bbc8-a661fce702b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.803740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5342d-2aa8-4817-bbc8-a661fce702b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.804267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5342d-2aa8-4817-bbc8-a661fce702b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.805118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5342d-2aa8-4817-bbc8-a661fce702b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:05.807910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5342d-2aa8-4817-bbc8-a661fce702b6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:05.851514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 915/1803] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/projects => generated 357 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:05.854412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5342d-2aa8-4817-bbc8-a661fce702b6 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:05.886805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171a61c-5a63-4f4d-9ec8-98fe36ec1776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:05.888317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171a61c-5a63-4f4d-9ec8-98fe36ec1776 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:05.902187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 889/1804] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:05.925181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:05.932167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d9a63-efe9-4a8e-a9e6-16d1f2262e87 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.945130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d9a63-efe9-4a8e-a9e6-16d1f2262e87 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.945130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d9a63-efe9-4a8e-a9e6-16d1f2262e87 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.945130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 890/1805] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:51:05 2022] GET /identity => generated 270 bytes in 38 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:05.945130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d9a63-efe9-4a8e-a9e6-16d1f2262e87 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:05.975149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5342d-2aa8-4817-bbc8-a661fce702b6 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:05.981196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37927f7-ed2f-48f8-af91-3769a3d5f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:05.981967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37927f7-ed2f-48f8-af91-3769a3d5f646 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:05.982162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37927f7-ed2f-48f8-af91-3769a3d5f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:05.982628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37927f7-ed2f-48f8-af91-3769a3d5f646 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:05.983376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37927f7-ed2f-48f8-af91-3769a3d5f646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:05.985379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37927f7-ed2f-48f8-af91-3769a3d5f646 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:06.025899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 916/1806] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:06.027551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e78ad7-e17b-448f-886a-563c47e120ed None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.027551 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e78ad7-e17b-448f-886a-563c47e120ed None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.028081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e78ad7-e17b-448f-886a-563c47e120ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.087539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-34e78ad7-e17b-448f-886a-563c47e120ed None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:06.101403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-34e78ad7-e17b-448f-886a-563c47e120ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:06.139877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d9a63-efe9-4a8e-a9e6-16d1f2262e87 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:06.147196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86acb4-287e-44f7-9252-51e6134fcd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:06.147981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86acb4-287e-44f7-9252-51e6134fcd98 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.148285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86acb4-287e-44f7-9252-51e6134fcd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.149085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86acb4-287e-44f7-9252-51e6134fcd98 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.149274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86acb4-287e-44f7-9252-51e6134fcd98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:06.152339 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86acb4-287e-44f7-9252-51e6134fcd98 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:06.209442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 891/1807] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:05 2022] POST /identity/v3/users => generated 279 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:06.214426 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86acb4-287e-44f7-9252-51e6134fcd98 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:06.244252 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86acb4-287e-44f7-9252-51e6134fcd98 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:06.257703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e6985-75ae-49ae-933b-9e67e77a6ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:06.257703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6985-75ae-49ae-933b-9e67e77a6ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.257969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6985-75ae-49ae-933b-9e67e77a6ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.258282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6985-75ae-49ae-933b-9e67e77a6ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.264076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e6985-75ae-49ae-933b-9e67e77a6ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:06.266668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e6985-75ae-49ae-933b-9e67e77a6ff3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:06.287622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 917/1808] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:51:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:06.289452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e78ad7-e17b-448f-886a-563c47e120ed None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:06.293504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 892/1809] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:06.304083 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e6985-75ae-49ae-933b-9e67e77a6ff3 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:06.331561 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e78ad7-e17b-448f-886a-563c47e120ed None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:06.339027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abb570-7950-46ee-aecb-69c31235de91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:06.340199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb570-7950-46ee-aecb-69c31235de91 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.340725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb570-7950-46ee-aecb-69c31235de91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.341208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb570-7950-46ee-aecb-69c31235de91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.343943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abb570-7950-46ee-aecb-69c31235de91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:06.346528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abb570-7950-46ee-aecb-69c31235de91 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:06.356126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e6985-75ae-49ae-933b-9e67e77a6ff3 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:06.366327 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 918/1810] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:06.366928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb26ed-52b4-446a-b6a5-527092b70b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:06.368819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abb570-7950-46ee-aecb-69c31235de91 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:06.369129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb26ed-52b4-446a-b6a5-527092b70b41 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.369592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb26ed-52b4-446a-b6a5-527092b70b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.369734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb26ed-52b4-446a-b6a5-527092b70b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.371524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb26ed-52b4-446a-b6a5-527092b70b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:06.375123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb26ed-52b4-446a-b6a5-527092b70b41 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:06.385336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abb570-7950-46ee-aecb-69c31235de91 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:06.399413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc7f8-8e79-4f1f-98b8-7b5970526b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:06.401016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc7f8-8e79-4f1f-98b8-7b5970526b85 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.401545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc7f8-8e79-4f1f-98b8-7b5970526b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.402266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc7f8-8e79-4f1f-98b8-7b5970526b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.403584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cc7f8-8e79-4f1f-98b8-7b5970526b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:06.405985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cc7f8-8e79-4f1f-98b8-7b5970526b85 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:06.407532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 893/1811] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:06.409459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb26ed-52b4-446a-b6a5-527092b70b41 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:06.422224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 919/1812] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:06.426284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc7f8-8e79-4f1f-98b8-7b5970526b85 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:06.430217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb26ed-52b4-446a-b6a5-527092b70b41 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:06.441702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc7f8-8e79-4f1f-98b8-7b5970526b85 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:06.445777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2e826-32c4-4e57-bbfb-a542435b14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:06.449471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e826-32c4-4e57-bbfb-a542435b14fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.450496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e826-32c4-4e57-bbfb-a542435b14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.451285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e826-32c4-4e57-bbfb-a542435b14fe admin admin] PATH_INFO: `/v3/projects/39dc44d80cdf4b9cabf795ca12f3a8c7/users/eed38eb3828f4a62a8fd7781760ab4c3/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.454266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cebb9-3ec1-412f-9c0b-23f6dfa68c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:06.456106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cebb9-3ec1-412f-9c0b-23f6dfa68c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.457688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cebb9-3ec1-412f-9c0b-23f6dfa68c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.458738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cebb9-3ec1-412f-9c0b-23f6dfa68c74 admin admin] PATH_INFO: `/v3/projects/09f5a4c3f1c84697bd67d25cab61d2fb/users/ae802a4e7390476a9a42890dce0c6276/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.506601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2e826-32c4-4e57-bbfb-a542435b14fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=39dc44d80cdf4b9cabf795ca12f3a8c7, user_id=eed38eb3828f4a62a8fd7781760ab4c3, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:06.514927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2e826-32c4-4e57-bbfb-a542435b14fe admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:06.522505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cebb9-3ec1-412f-9c0b-23f6dfa68c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f5a4c3f1c84697bd67d25cab61d2fb, user_id=ae802a4e7390476a9a42890dce0c6276, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:06.538776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cebb9-3ec1-412f-9c0b-23f6dfa68c74 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:06.565228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:06.571832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 920/1813] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:06 2022] PUT /identity/v3/projects/09f5a4c3f1c84697bd67d25cab61d2fb/users/ae802a4e7390476a9a42890dce0c6276/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:06.586948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a48f6-baa9-4ab1-adea-518593f6d556 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.587245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a48f6-baa9-4ab1-adea-518593f6d556 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.587529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a48f6-baa9-4ab1-adea-518593f6d556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.593721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 894/1814] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:06 2022] PUT /identity/v3/projects/39dc44d80cdf4b9cabf795ca12f3a8c7/users/eed38eb3828f4a62a8fd7781760ab4c3/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:06.606369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0868522-a39d-4d89-91d0-94cc0e3e1e9f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.606867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0868522-a39d-4d89-91d0-94cc0e3e1e9f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.607256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0868522-a39d-4d89-91d0-94cc0e3e1e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.644258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-c28a48f6-baa9-4ab1-adea-518593f6d556 None None] MFA Rules not processed for user `ae802a4e7390476a9a42890dce0c6276`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:06.654211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c28a48f6-baa9-4ab1-adea-518593f6d556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:06.669182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c0868522-a39d-4d89-91d0-94cc0e3e1e9f None None] MFA Rules not processed for user `eed38eb3828f4a62a8fd7781760ab4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:06.673139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c0868522-a39d-4d89-91d0-94cc0e3e1e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:06.766675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:06.782451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 921/1815] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:06 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:06.785077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a48f6-baa9-4ab1-adea-518593f6d556 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:06.833680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 895/1816] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:06.838344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0868522-a39d-4d89-91d0-94cc0e3e1e9f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:06.896509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a48f6-baa9-4ab1-adea-518593f6d556 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:06.904075 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0c7f8-f708-4587-9e07-d37ead63e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:06.905140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0c7f8-f708-4587-9e07-d37ead63e43a admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:06.905529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0c7f8-f708-4587-9e07-d37ead63e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:06.906008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0c7f8-f708-4587-9e07-d37ead63e43a admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:06.906825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0c7f8-f708-4587-9e07-d37ead63e43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:06.909985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0c7f8-f708-4587-9e07-d37ead63e43a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:06.969962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 922/1817] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:06 2022] POST /identity/v3/projects => generated 353 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:06.971261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0c7f8-f708-4587-9e07-d37ead63e43a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:06.975046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f2d0c7f8-f708-4587-9e07-d37ead63e43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:06.980857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0868522-a39d-4d89-91d0-94cc0e3e1e9f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.113754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b24049-62f0-4ccd-86dd-4b94b90a6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.114812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24049-62f0-4ccd-86dd-4b94b90a6534 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.115249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24049-62f0-4ccd-86dd-4b94b90a6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.115717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b24049-62f0-4ccd-86dd-4b94b90a6534 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.116511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b24049-62f0-4ccd-86dd-4b94b90a6534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.118563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b24049-62f0-4ccd-86dd-4b94b90a6534 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.129080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0c7f8-f708-4587-9e07-d37ead63e43a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.136558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd6751-05bf-430e-bfa4-77f1e158d3c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.137744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd6751-05bf-430e-bfa4-77f1e158d3c3 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.138062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd6751-05bf-430e-bfa4-77f1e158d3c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.138350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd6751-05bf-430e-bfa4-77f1e158d3c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.153088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd6751-05bf-430e-bfa4-77f1e158d3c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.154768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd6751-05bf-430e-bfa4-77f1e158d3c3 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.161106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 896/1818] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:06 2022] POST /identity/v3/projects => generated 373 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:07.162081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b24049-62f0-4ccd-86dd-4b94b90a6534 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:07.179402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 923/1819] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:07.181008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd6751-05bf-430e-bfa4-77f1e158d3c3 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:07.199815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd6751-05bf-430e-bfa4-77f1e158d3c3 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.207340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:07.328973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b24049-62f0-4ccd-86dd-4b94b90a6534 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.336322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a9f8-673a-4ff5-a469-d9274098526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.339638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a9f8-673a-4ff5-a469-d9274098526e admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.340071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a9f8-673a-4ff5-a469-d9274098526e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.340574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67a9f8-673a-4ff5-a469-d9274098526e admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.342358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67a9f8-673a-4ff5-a469-d9274098526e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.344477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67a9f8-673a-4ff5-a469-d9274098526e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.382438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 897/1820] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:07 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:07.382600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359ade7-3fab-4b0f-8867-c1a522e70688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.382600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ade7-3fab-4b0f-8867-c1a522e70688 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.382600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ade7-3fab-4b0f-8867-c1a522e70688 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.382600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ade7-3fab-4b0f-8867-c1a522e70688 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.382909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359ade7-3fab-4b0f-8867-c1a522e70688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.384007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a9f8-673a-4ff5-a469-d9274098526e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:07.384240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359ade7-3fab-4b0f-8867-c1a522e70688 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.399089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67a9f8-673a-4ff5-a469-d9274098526e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.407841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56240a06-6cb7-43f0-8bea-c9d10e2a4f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.408695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56240a06-6cb7-43f0-8bea-c9d10e2a4f1a admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.409518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56240a06-6cb7-43f0-8bea-c9d10e2a4f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.411915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56240a06-6cb7-43f0-8bea-c9d10e2a4f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.412093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56240a06-6cb7-43f0-8bea-c9d10e2a4f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.417884 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56240a06-6cb7-43f0-8bea-c9d10e2a4f1a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.428474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:07.436772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 924/1821] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:07 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:07.440278 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359ade7-3fab-4b0f-8867-c1a522e70688 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:07.453626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 898/1822] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:07.455041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359ade7-3fab-4b0f-8867-c1a522e70688 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.455469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56240a06-6cb7-43f0-8bea-c9d10e2a4f1a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:07.468397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1796ad-e86a-4c46-8851-438227b9dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.469142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1796ad-e86a-4c46-8851-438227b9dff7 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.469462 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1796ad-e86a-4c46-8851-438227b9dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.469751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1796ad-e86a-4c46-8851-438227b9dff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.473157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1796ad-e86a-4c46-8851-438227b9dff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.481762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1796ad-e86a-4c46-8851-438227b9dff7 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.487444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56240a06-6cb7-43f0-8bea-c9d10e2a4f1a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.526189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 925/1823] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:07.530828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1796ad-e86a-4c46-8851-438227b9dff7 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:07.531776 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e514b65-2197-4305-8d94-d36b9bbeb674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.534986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e514b65-2197-4305-8d94-d36b9bbeb674 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.534986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e514b65-2197-4305-8d94-d36b9bbeb674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.534986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e514b65-2197-4305-8d94-d36b9bbeb674 admin admin] PATH_INFO: `/v3/projects/f4654650b79740c58adeaf404fbeeff5/users/81047d212011486194ffa9771d2bc620/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.561210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e514b65-2197-4305-8d94-d36b9bbeb674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4654650b79740c58adeaf404fbeeff5, user_id=81047d212011486194ffa9771d2bc620, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.565055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e514b65-2197-4305-8d94-d36b9bbeb674 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.573429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1796ad-e86a-4c46-8851-438227b9dff7 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.588581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd2fa9-6e98-4d11-b69d-cfe268dc3e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.590599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd2fa9-6e98-4d11-b69d-cfe268dc3e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.590916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd2fa9-6e98-4d11-b69d-cfe268dc3e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.591189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd2fa9-6e98-4d11-b69d-cfe268dc3e08 admin admin] PATH_INFO: `/v3/projects/4a8784a5fcc24011a25025ac09cea592/users/0f789606385d46168967605f66f7685b/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.599445 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 899/1824] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:07 2022] PUT /identity/v3/projects/f4654650b79740c58adeaf404fbeeff5/users/81047d212011486194ffa9771d2bc620/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:07.606134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e514b65-2197-4305-8d94-d36b9bbeb674 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:07.635619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd2fa9-6e98-4d11-b69d-cfe268dc3e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8784a5fcc24011a25025ac09cea592, user_id=0f789606385d46168967605f66f7685b, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.648806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd2fa9-6e98-4d11-b69d-cfe268dc3e08 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.715598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 926/1825] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:07 2022] PUT /identity/v3/projects/4a8784a5fcc24011a25025ac09cea592/users/0f789606385d46168967605f66f7685b/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:07.723431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd2fa9-6e98-4d11-b69d-cfe268dc3e08 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:07.759431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e514b65-2197-4305-8d94-d36b9bbeb674 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.930136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd2fa9-6e98-4d11-b69d-cfe268dc3e08 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:07.953341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414c2e8-a293-4fe1-b39c-fdf64b8dcb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.954338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f8563-b291-4798-aac0-9580c4346495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:07.954560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414c2e8-a293-4fe1-b39c-fdf64b8dcb2d admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.955020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414c2e8-a293-4fe1-b39c-fdf64b8dcb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.956013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414c2e8-a293-4fe1-b39c-fdf64b8dcb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.958236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f8563-b291-4798-aac0-9580c4346495 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:07.958724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f8563-b291-4798-aac0-9580c4346495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:07.959146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f8563-b291-4798-aac0-9580c4346495 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:07.960393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f8563-b291-4798-aac0-9580c4346495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.961851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414c2e8-a293-4fe1-b39c-fdf64b8dcb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:07.963246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f8563-b291-4798-aac0-9580c4346495 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.967832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414c2e8-a293-4fe1-b39c-fdf64b8dcb2d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:07.984646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 900/1826] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:07.984646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f8563-b291-4798-aac0-9580c4346495 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:07.987237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ac3f8563-b291-4798-aac0-9580c4346495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:08.019089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:08.021047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 927/1827] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:08.022827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414c2e8-a293-4fe1-b39c-fdf64b8dcb2d admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:08.065907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414c2e8-a293-4fe1-b39c-fdf64b8dcb2d admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:08.085182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0c94-54c6-4acf-baba-1db80ba1c050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:08.087008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0c94-54c6-4acf-baba-1db80ba1c050 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.087469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0c94-54c6-4acf-baba-1db80ba1c050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.088016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0c94-54c6-4acf-baba-1db80ba1c050 admin admin] PATH_INFO: `/v3/projects/f4654650b79740c58adeaf404fbeeff5/users/81047d212011486194ffa9771d2bc620/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.096457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0c94-54c6-4acf-baba-1db80ba1c050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4654650b79740c58adeaf404fbeeff5, user_id=81047d212011486194ffa9771d2bc620, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:08.101684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0c94-54c6-4acf-baba-1db80ba1c050 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:08.102141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f8563-b291-4798-aac0-9580c4346495 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:08.107724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95ac5d-854a-4343-bdbd-d90dd153e2a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:08.109127 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95ac5d-854a-4343-bdbd-d90dd153e2a2 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.109734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95ac5d-854a-4343-bdbd-d90dd153e2a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.110276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95ac5d-854a-4343-bdbd-d90dd153e2a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.123869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 928/1828] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:08 2022] PUT /identity/v3/projects/f4654650b79740c58adeaf404fbeeff5/users/81047d212011486194ffa9771d2bc620/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:08.133657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0c94-54c6-4acf-baba-1db80ba1c050 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:08.240842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0c94-54c6-4acf-baba-1db80ba1c050 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:08.248109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d93ba-a1eb-45f4-b39e-9ce50afc0172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:08.249031 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d93ba-a1eb-45f4-b39e-9ce50afc0172 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.249314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d93ba-a1eb-45f4-b39e-9ce50afc0172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.249595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d93ba-a1eb-45f4-b39e-9ce50afc0172 admin admin] PATH_INFO: `/v3/projects/4a8784a5fcc24011a25025ac09cea592/users/0f789606385d46168967605f66f7685b/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.250139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95ac5d-854a-4343-bdbd-d90dd153e2a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:08.252316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95ac5d-854a-4343-bdbd-d90dd153e2a2 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:08.255597 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d93ba-a1eb-45f4-b39e-9ce50afc0172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8784a5fcc24011a25025ac09cea592, user_id=0f789606385d46168967605f66f7685b, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:08.258311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d93ba-a1eb-45f4-b39e-9ce50afc0172 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:08.280847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 901/1829] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:08.282352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1276e-a481-40ea-b688-403af39c80d5 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.282783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1276e-a481-40ea-b688-403af39c80d5 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.283243 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1276e-a481-40ea-b688-403af39c80d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.290213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 929/1830] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:08 2022] PUT /identity/v3/projects/4a8784a5fcc24011a25025ac09cea592/users/0f789606385d46168967605f66f7685b/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:08.301713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576cbc2-2f27-4978-a838-bf9c32193d84 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.301896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576cbc2-2f27-4978-a838-bf9c32193d84 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.302176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576cbc2-2f27-4978-a838-bf9c32193d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.327890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-4eb1276e-a481-40ea-b688-403af39c80d5 None None] MFA Rules not processed for user `81047d212011486194ffa9771d2bc620`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:08.329169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4eb1276e-a481-40ea-b688-403af39c80d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:08.378536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-6576cbc2-2f27-4978-a838-bf9c32193d84 None None] MFA Rules not processed for user `0f789606385d46168967605f66f7685b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:08.379904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6576cbc2-2f27-4978-a838-bf9c32193d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:08.435820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 902/1831] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:08.441105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:08.449365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1276e-a481-40ea-b688-403af39c80d5 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:08.519249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 930/1832] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:08.541374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576cbc2-2f27-4978-a838-bf9c32193d84 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:08.549424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1276e-a481-40ea-b688-403af39c80d5 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:08.553996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576cbc2-2f27-4978-a838-bf9c32193d84 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:08.554225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90688a93-616a-4ad2-b447-bf749f694b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:08.554225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90688a93-616a-4ad2-b447-bf749f694b28 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.554225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90688a93-616a-4ad2-b447-bf749f694b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.554554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90688a93-616a-4ad2-b447-bf749f694b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.555549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24865283-a7f4-466d-82fe-eaf9d963fb1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:08.556161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24865283-a7f4-466d-82fe-eaf9d963fb1a service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.556519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24865283-a7f4-466d-82fe-eaf9d963fb1a service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.556910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24865283-a7f4-466d-82fe-eaf9d963fb1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.561831 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:08.567249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90688a93-616a-4ad2-b447-bf749f694b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:08.569385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90688a93-616a-4ad2-b447-bf749f694b28 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:08.580579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 903/1833] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:08 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:08.633371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24865283-a7f4-466d-82fe-eaf9d963fb1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:08.634962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24865283-a7f4-466d-82fe-eaf9d963fb1a service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:08.648350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 931/1834] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:08.875177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90688a93-616a-4ad2-b447-bf749f694b28 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:08.884189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90688a93-616a-4ad2-b447-bf749f694b28 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:08.890373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb62fd-ce31-4e94-95bb-4949e09a0d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:08.891678 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb62fd-ce31-4e94-95bb-4949e09a0d89 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:08.891972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb62fd-ce31-4e94-95bb-4949e09a0d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:08.892250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb62fd-ce31-4e94-95bb-4949e09a0d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:08.984059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb62fd-ce31-4e94-95bb-4949e09a0d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:08.986946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb62fd-ce31-4e94-95bb-4949e09a0d89 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:09.007781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 904/1835] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:08 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:11.794441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24865283-a7f4-466d-82fe-eaf9d963fb1a service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:11.805278 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24865283-a7f4-466d-82fe-eaf9d963fb1a service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:11.811850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffac1b3-c154-4951-85df-dabd081e8a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:11.813538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffac1b3-c154-4951-85df-dabd081e8a06 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:11.814042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffac1b3-c154-4951-85df-dabd081e8a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:11.814519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffac1b3-c154-4951-85df-dabd081e8a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:11.832344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffac1b3-c154-4951-85df-dabd081e8a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:11.837549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffac1b3-c154-4951-85df-dabd081e8a06 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:11.858404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 932/1836] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:12.156372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb62fd-ce31-4e94-95bb-4949e09a0d89 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:12.158667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-20eb62fd-ce31-4e94-95bb-4949e09a0d89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:12.283153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb62fd-ce31-4e94-95bb-4949e09a0d89 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:12.293341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:12.294478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:12.294764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:12.295100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] PATH_INFO: `/v3/users/f3cd5287280a41b6bd1b89df4cb3a94c` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:12.297304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3cd5287280a41b6bd1b89df4cb3a94c)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:12.300190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:12.406172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cd5287280a41b6bd1b89df4cb3a94c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:12.438302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cd5287280a41b6bd1b89df4cb3a94c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:12.439352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cd5287280a41b6bd1b89df4cb3a94c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:12.449432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cd5287280a41b6bd1b89df4cb3a94c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:12.465940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cd5287280a41b6bd1b89df4cb3a94c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:12.473936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 905/1837] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:12 2022] DELETE /identity/v3/users/f3cd5287280a41b6bd1b89df4cb3a94c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:12.479747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba763b-4ab5-4d61-a21f-9d559dd1fe57 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:12.480223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba763b-4ab5-4d61-a21f-9d559dd1fe57 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:12.480541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba763b-4ab5-4d61-a21f-9d559dd1fe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:12.509729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-09ba763b-4ab5-4d61-a21f-9d559dd1fe57 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:12.510934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-09ba763b-4ab5-4d61-a21f-9d559dd1fe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:12.627193 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 933/1838] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:12.637739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:12.639322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:12.669659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:12.718320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c45ae-8c0c-4e07-ae24-e658f54003ec admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:12.724344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ac387-9966-4814-9ec9-c3e6db919559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:12.725351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac387-9966-4814-9ec9-c3e6db919559 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:12.725833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac387-9966-4814-9ec9-c3e6db919559 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:12.726278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac387-9966-4814-9ec9-c3e6db919559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:12.738407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ac387-9966-4814-9ec9-c3e6db919559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:12.739774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ac387-9966-4814-9ec9-c3e6db919559 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:12.750125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 906/1839] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:13.113859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba763b-4ab5-4d61-a21f-9d559dd1fe57 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:13.115359 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-09ba763b-4ab5-4d61-a21f-9d559dd1fe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:13.148037 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba763b-4ab5-4d61-a21f-9d559dd1fe57 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:13.154569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:13.155842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:13.156159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:13.156545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] PATH_INFO: `/v3/projects/9fac4cdfc72c46bdaaa44e8d28cc26b9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:13.157922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fac4cdfc72c46bdaaa44e8d28cc26b9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:13.160221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:13.220147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:13.221665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fac4cdfc72c46bdaaa44e8d28cc26b9', 'request_id': 'req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.235295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fac4cdfc72c46bdaaa44e8d28cc26b9', 'request_id': 'req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.244912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fac4cdfc72c46bdaaa44e8d28cc26b9', 'request_id': 'req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.257634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] The token cache is being invalidate because project 9fac4cdfc72c46bdaaa44e8d28cc26b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:13.257902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.258713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.261318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 934/1840] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:13 2022] DELETE /identity/v3/projects/9fac4cdfc72c46bdaaa44e8d28cc26b9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:13.264991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ac387-9966-4814-9ec9-c3e6db919559 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:13.275980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ac387-9966-4814-9ec9-c3e6db919559 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:13.396458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:13.397607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:13.398040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:13.398450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] PATH_INFO: `/v3/users/9a8834a779e74081811cca2bd9c22259` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:13.400732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8834a779e74081811cca2bd9c22259)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:13.402921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:13.460465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8834a779e74081811cca2bd9c22259'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.479238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8834a779e74081811cca2bd9c22259'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.480180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8834a779e74081811cca2bd9c22259'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.491150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8834a779e74081811cca2bd9c22259'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.510263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c1544aac-9841-4327-a303-338da957c634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8834a779e74081811cca2bd9c22259'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:13.522191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 907/1841] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:13 2022] DELETE /identity/v3/users/9a8834a779e74081811cca2bd9c22259 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:13.999969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:14.001487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:14.018126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef5f8-c2a8-41b8-8da1-c3cf11ea48bc admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:14.099941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:14.100824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.101157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.101485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] PATH_INFO: `/v3/projects/1db25581591343b9acc7a83c4ed9b2c5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.103027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db25581591343b9acc7a83c4ed9b2c5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:14.105110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:14.161166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db25581591343b9acc7a83c4ed9b2c5', 'request_id': 'req-908878a3-4f8b-440b-9db8-eb7691a0f80d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:14.169927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db25581591343b9acc7a83c4ed9b2c5', 'request_id': 'req-908878a3-4f8b-440b-9db8-eb7691a0f80d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:14.182276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db25581591343b9acc7a83c4ed9b2c5', 'request_id': 'req-908878a3-4f8b-440b-9db8-eb7691a0f80d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:14.194967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] The token cache is being invalidate because project 1db25581591343b9acc7a83c4ed9b2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:14.195273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:14.196111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-908878a3-4f8b-440b-9db8-eb7691a0f80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:14.202564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 935/1842] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:13 2022] DELETE /identity/v3/projects/1db25581591343b9acc7a83c4ed9b2c5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:14.206575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af613c-ddf0-43cd-9b53-c0e849ec6fce None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.207076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af613c-ddf0-43cd-9b53-c0e849ec6fce None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.207519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af613c-ddf0-43cd-9b53-c0e849ec6fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.229035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-46af613c-ddf0-43cd-9b53-c0e849ec6fce None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:14.230698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-46af613c-ddf0-43cd-9b53-c0e849ec6fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:14.271892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:14.315188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 908/1843] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:14.326125 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2898-93e5-4361-8d6d-db71c13581b8 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.327405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2898-93e5-4361-8d6d-db71c13581b8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.328264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce2898-93e5-4361-8d6d-db71c13581b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.372937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-02ce2898-93e5-4361-8d6d-db71c13581b8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:14.374410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-02ce2898-93e5-4361-8d6d-db71c13581b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:14.387006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 936/1844] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:14.387764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af613c-ddf0-43cd-9b53-c0e849ec6fce None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:14.402855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af613c-ddf0-43cd-9b53-c0e849ec6fce None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:14.424365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f480e38-f965-4f13-9015-3b0c86efa5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:14.429731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480e38-f965-4f13-9015-3b0c86efa5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.430348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480e38-f965-4f13-9015-3b0c86efa5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.432795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480e38-f965-4f13-9015-3b0c86efa5e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.435474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f480e38-f965-4f13-9015-3b0c86efa5e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:14.438230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f480e38-f965-4f13-9015-3b0c86efa5e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:14.444956 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f480e38-f965-4f13-9015-3b0c86efa5e7 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:14.473752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 909/1845] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:14.478580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2898-93e5-4361-8d6d-db71c13581b8 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:14.488329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce2898-93e5-4361-8d6d-db71c13581b8 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:14.493422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a69d1-805f-448c-a985-ce7c1bb0e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:14.494711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a69d1-805f-448c-a985-ce7c1bb0e31a admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.494993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a69d1-805f-448c-a985-ce7c1bb0e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.495266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a69d1-805f-448c-a985-ce7c1bb0e31a admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.498431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a69d1-805f-448c-a985-ce7c1bb0e31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:14.498431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a69d1-805f-448c-a985-ce7c1bb0e31a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:14.529331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 937/1846] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:14 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:14.533175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f480e38-f965-4f13-9015-3b0c86efa5e7 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:14.545550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f480e38-f965-4f13-9015-3b0c86efa5e7 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:14.614159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093416-9a4d-4d2e-85ee-23d6a148ac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:14.614885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093416-9a4d-4d2e-85ee-23d6a148ac04 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.615391 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093416-9a4d-4d2e-85ee-23d6a148ac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.615763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06093416-9a4d-4d2e-85ee-23d6a148ac04 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.616479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06093416-9a4d-4d2e-85ee-23d6a148ac04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:14.619293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06093416-9a4d-4d2e-85ee-23d6a148ac04 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:14.642626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 910/1847] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:14 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:14.647247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a69d1-805f-448c-a985-ce7c1bb0e31a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:14.659648 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a69d1-805f-448c-a985-ce7c1bb0e31a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:14.664571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eefe98-d93c-4623-9a75-69d7fee780be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:14.665258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eefe98-d93c-4623-9a75-69d7fee780be admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.666080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eefe98-d93c-4623-9a75-69d7fee780be admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.666365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eefe98-d93c-4623-9a75-69d7fee780be admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.668637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eefe98-d93c-4623-9a75-69d7fee780be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:14.670265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eefe98-d93c-4623-9a75-69d7fee780be admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:14.681980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 938/1848] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:14.685939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093416-9a4d-4d2e-85ee-23d6a148ac04 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:14.696271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06093416-9a4d-4d2e-85ee-23d6a148ac04 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:14.704522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c00f60-4b30-452b-b164-0e0d84353dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:14.705404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00f60-4b30-452b-b164-0e0d84353dfc admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.705695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00f60-4b30-452b-b164-0e0d84353dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.705975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00f60-4b30-452b-b164-0e0d84353dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.706783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c00f60-4b30-452b-b164-0e0d84353dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:14.708420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c00f60-4b30-452b-b164-0e0d84353dfc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:14.719782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 911/1849] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:14.723971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eefe98-d93c-4623-9a75-69d7fee780be admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:14.734321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eefe98-d93c-4623-9a75-69d7fee780be admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:14.739797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129110e6-23e6-40ac-aa39-9a6195e2e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:14.740702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129110e6-23e6-40ac-aa39-9a6195e2e273 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.740980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129110e6-23e6-40ac-aa39-9a6195e2e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.741251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129110e6-23e6-40ac-aa39-9a6195e2e273 admin admin] PATH_INFO: `/v3/projects/e3b2d7c84b5c4d05aa8acfb694cb2b37/users/ac8ac47a025f4f169d4ade44aca9fd93/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.757763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129110e6-23e6-40ac-aa39-9a6195e2e273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b2d7c84b5c4d05aa8acfb694cb2b37, user_id=ac8ac47a025f4f169d4ade44aca9fd93, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:14.761021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129110e6-23e6-40ac-aa39-9a6195e2e273 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:14.783028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 939/1850] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:14 2022] PUT /identity/v3/projects/e3b2d7c84b5c4d05aa8acfb694cb2b37/users/ac8ac47a025f4f169d4ade44aca9fd93/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:14.793502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01f699-e8d9-4d11-adb8-7f53d110dd5a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:14.793823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01f699-e8d9-4d11-adb8-7f53d110dd5a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:14.794182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01f699-e8d9-4d11-adb8-7f53d110dd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:14.824977 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7c01f699-e8d9-4d11-adb8-7f53d110dd5a None None] MFA Rules not processed for user `ac8ac47a025f4f169d4ade44aca9fd93`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:14.826179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7c01f699-e8d9-4d11-adb8-7f53d110dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:14.904396 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 912/1851] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:14.913222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129110e6-23e6-40ac-aa39-9a6195e2e273 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:14.918300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:15.039005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129110e6-23e6-40ac-aa39-9a6195e2e273 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:15.044116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d28c-8c71-41bf-9d50-b8de51778c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:15.044897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d28c-8c71-41bf-9d50-b8de51778c26 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.045378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d28c-8c71-41bf-9d50-b8de51778c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.045741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7d28c-8c71-41bf-9d50-b8de51778c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.046832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d28c-8c71-41bf-9d50-b8de51778c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:15.049446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7d28c-8c71-41bf-9d50-b8de51778c26 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:15.083433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 940/1852] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:14 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:15.087118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01f699-e8d9-4d11-adb8-7f53d110dd5a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:15.098519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01f699-e8d9-4d11-adb8-7f53d110dd5a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:15.130859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:15.168292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591979bd-7d01-48ea-b01f-3f4632fe152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:15.169512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591979bd-7d01-48ea-b01f-3f4632fe152b admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.169816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591979bd-7d01-48ea-b01f-3f4632fe152b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.170323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591979bd-7d01-48ea-b01f-3f4632fe152b admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.171218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591979bd-7d01-48ea-b01f-3f4632fe152b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:15.173529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591979bd-7d01-48ea-b01f-3f4632fe152b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:15.215210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 913/1853] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:15 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:15.219701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d28c-8c71-41bf-9d50-b8de51778c26 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:15.234216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7d28c-8c71-41bf-9d50-b8de51778c26 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:15.241738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a03aa-1308-4983-8ed2-78891c6075d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:15.242604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a03aa-1308-4983-8ed2-78891c6075d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.243055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a03aa-1308-4983-8ed2-78891c6075d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.243576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a03aa-1308-4983-8ed2-78891c6075d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.244733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a03aa-1308-4983-8ed2-78891c6075d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:15.246502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a03aa-1308-4983-8ed2-78891c6075d0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:15.260662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 941/1854] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:15.267342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591979bd-7d01-48ea-b01f-3f4632fe152b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:15.278882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591979bd-7d01-48ea-b01f-3f4632fe152b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:15.285736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87baef-919c-4256-9ef8-0600eb9a5ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:15.287126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87baef-919c-4256-9ef8-0600eb9a5ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.287774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87baef-919c-4256-9ef8-0600eb9a5ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.288299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87baef-919c-4256-9ef8-0600eb9a5ed7 admin admin] PATH_INFO: `/v3/projects/1935be888ebc4c0894609c0eab6bb05d/users/118195b6c43d48c3a27bf85152a0b005/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.306998 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87baef-919c-4256-9ef8-0600eb9a5ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1935be888ebc4c0894609c0eab6bb05d, user_id=118195b6c43d48c3a27bf85152a0b005, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:15.310079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87baef-919c-4256-9ef8-0600eb9a5ed7 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:15.327211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 914/1855] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:15 2022] PUT /identity/v3/projects/1935be888ebc4c0894609c0eab6bb05d/users/118195b6c43d48c3a27bf85152a0b005/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:15.332520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a03aa-1308-4983-8ed2-78891c6075d0 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:15.350337 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a03aa-1308-4983-8ed2-78891c6075d0 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:15.564026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcd29d-025d-4ddc-8dad-e957445ecb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:15.564904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcd29d-025d-4ddc-8dad-e957445ecb52 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.565214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcd29d-025d-4ddc-8dad-e957445ecb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.565562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcd29d-025d-4ddc-8dad-e957445ecb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.566403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcd29d-025d-4ddc-8dad-e957445ecb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:15.572325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcd29d-025d-4ddc-8dad-e957445ecb52 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:15.586710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 942/1856] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:15.591549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87baef-919c-4256-9ef8-0600eb9a5ed7 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:15.607432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87baef-919c-4256-9ef8-0600eb9a5ed7 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:15.624462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4ded-a555-402b-9c34-b0d5fc68a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:15.625244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4ded-a555-402b-9c34-b0d5fc68a14f admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.625533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4ded-a555-402b-9c34-b0d5fc68a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.625840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4ded-a555-402b-9c34-b0d5fc68a14f admin admin] PATH_INFO: `/v3/projects/1935be888ebc4c0894609c0eab6bb05d/users/118195b6c43d48c3a27bf85152a0b005/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.629455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4ded-a555-402b-9c34-b0d5fc68a14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1935be888ebc4c0894609c0eab6bb05d, user_id=118195b6c43d48c3a27bf85152a0b005, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:15.632573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4ded-a555-402b-9c34-b0d5fc68a14f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:15.646452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 915/1857] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:15 2022] PUT /identity/v3/projects/1935be888ebc4c0894609c0eab6bb05d/users/118195b6c43d48c3a27bf85152a0b005/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:15.661536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203f712-9f04-445e-9afe-c2bef9fa2ac0 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.661536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203f712-9f04-445e-9afe-c2bef9fa2ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.661536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203f712-9f04-445e-9afe-c2bef9fa2ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:15.707163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1203f712-9f04-445e-9afe-c2bef9fa2ac0 None None] MFA Rules not processed for user `118195b6c43d48c3a27bf85152a0b005`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:15.709070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1203f712-9f04-445e-9afe-c2bef9fa2ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:15.848672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:15.859861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 943/1858] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:15.867323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4ded-a555-402b-9c34-b0d5fc68a14f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:15.870630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-434b4ded-a555-402b-9c34-b0d5fc68a14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:15.971112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4ded-a555-402b-9c34-b0d5fc68a14f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:15.979148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b882a-137b-45cd-9ed8-7ce584c2c5d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:15.980000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b882a-137b-45cd-9ed8-7ce584c2c5d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:15.980357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b882a-137b-45cd-9ed8-7ce584c2c5d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:15.980704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b882a-137b-45cd-9ed8-7ce584c2c5d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:16.068901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b882a-137b-45cd-9ed8-7ce584c2c5d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:16.070945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b882a-137b-45cd-9ed8-7ce584c2c5d6 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:16.100505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 916/1859] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:20.947355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203f712-9f04-445e-9afe-c2bef9fa2ac0 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:20.961574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203f712-9f04-445e-9afe-c2bef9fa2ac0 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:20.967542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbbb94-16d2-4517-97fb-27d385684b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:20.969517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbbb94-16d2-4517-97fb-27d385684b30 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:20.970228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbbb94-16d2-4517-97fb-27d385684b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:20.970845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbbb94-16d2-4517-97fb-27d385684b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:20.986930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbbb94-16d2-4517-97fb-27d385684b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:20.988890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbbb94-16d2-4517-97fb-27d385684b30 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:21.003049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 944/1860] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:21.315822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b882a-137b-45cd-9ed8-7ce584c2c5d6 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:21.317635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-727b882a-137b-45cd-9ed8-7ce584c2c5d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:21.333570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b882a-137b-45cd-9ed8-7ce584c2c5d6 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:21.339161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8549a9-e22e-4b3a-84df-774ea255849e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:21.339976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8549a9-e22e-4b3a-84df-774ea255849e service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:21.340372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8549a9-e22e-4b3a-84df-774ea255849e service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:21.340942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8549a9-e22e-4b3a-84df-774ea255849e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:21.343555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1e8549a9-e22e-4b3a-84df-774ea255849e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:21.437827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:21.477674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8549a9-e22e-4b3a-84df-774ea255849e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:21.479177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8549a9-e22e-4b3a-84df-774ea255849e service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:21.490021 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 917/1861] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:26.323268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbbb94-16d2-4517-97fb-27d385684b30 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:26.324946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c8cbbb94-16d2-4517-97fb-27d385684b30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:26.402709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbbb94-16d2-4517-97fb-27d385684b30 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:26.407999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:26.408984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:26.409179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:26.409534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] PATH_INFO: `/v3/users/ae802a4e7390476a9a42890dce0c6276` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:26.411028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae802a4e7390476a9a42890dce0c6276)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:26.413230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:26.466784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae802a4e7390476a9a42890dce0c6276'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.481234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae802a4e7390476a9a42890dce0c6276'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.481970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae802a4e7390476a9a42890dce0c6276'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.489142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae802a4e7390476a9a42890dce0c6276'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.496832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae802a4e7390476a9a42890dce0c6276'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.506426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 945/1862] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:26 2022] DELETE /identity/v3/users/ae802a4e7390476a9a42890dce0c6276 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:26.511458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90ef97-a430-4e50-86cf-9ba31bf61041 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:26.511982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90ef97-a430-4e50-86cf-9ba31bf61041 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:26.512073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90ef97-a430-4e50-86cf-9ba31bf61041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:26.530086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-4c90ef97-a430-4e50-86cf-9ba31bf61041 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:26.531335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4c90ef97-a430-4e50-86cf-9ba31bf61041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:26.534779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:26.536251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:26.602148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 918/1863] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:26.606152 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90ef97-a430-4e50-86cf-9ba31bf61041 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:26.606152 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4c90ef97-a430-4e50-86cf-9ba31bf61041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:26.614541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2704-b860-428a-8082-b9a515b72dc9 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:26.618895 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90ef97-a430-4e50-86cf-9ba31bf61041 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:26.619701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:26.620900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:26.621189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:26.621473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] PATH_INFO: `/v3/users/ac8ac47a025f4f169d4ade44aca9fd93` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:26.622779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8ac47a025f4f169d4ade44aca9fd93)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:26.624007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:26.624700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:26.624887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:26.625178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:26.625738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] PATH_INFO: `/v3/users/eed38eb3828f4a62a8fd7781760ab4c3` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:26.627147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed38eb3828f4a62a8fd7781760ab4c3)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:26.629541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:26.630266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:26.693028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed38eb3828f4a62a8fd7781760ab4c3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.694576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8ac47a025f4f169d4ade44aca9fd93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.705836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed38eb3828f4a62a8fd7781760ab4c3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.706678 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed38eb3828f4a62a8fd7781760ab4c3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.710743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8ac47a025f4f169d4ade44aca9fd93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.711466 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8ac47a025f4f169d4ade44aca9fd93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.715189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed38eb3828f4a62a8fd7781760ab4c3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.721440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8ac47a025f4f169d4ade44aca9fd93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.726533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed38eb3828f4a62a8fd7781760ab4c3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.732413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a7eb0d22-9770-4121-8010-25e1b8b7a928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8ac47a025f4f169d4ade44aca9fd93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:26.739020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 919/1864] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:26 2022] DELETE /identity/v3/users/eed38eb3828f4a62a8fd7781760ab4c3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:26.740402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:26.741290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 946/1865] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:26 2022] DELETE /identity/v3/users/ac8ac47a025f4f169d4ade44aca9fd93 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:26.743447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3d17-d87f-4bd2-904e-55b96901f6e3 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:26.743789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3d17-d87f-4bd2-904e-55b96901f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:26.744196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d3d17-d87f-4bd2-904e-55b96901f6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:26.745448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:26.767004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ba0d3d17-d87f-4bd2-904e-55b96901f6e3 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:26.768621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ba0d3d17-d87f-4bd2-904e-55b96901f6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:26.823150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:26.858338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d094d-ecf2-4059-8b45-ff9a82546e7a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:26.863753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 947/1866] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:26.863753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545be616-14da-498f-b41b-548947519fca None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:26.863753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545be616-14da-498f-b41b-548947519fca None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:26.863753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545be616-14da-498f-b41b-548947519fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:26.885555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-545be616-14da-498f-b41b-548947519fca None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:26.889407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-545be616-14da-498f-b41b-548947519fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:26.899388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 948/1867] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:26.903112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545be616-14da-498f-b41b-548947519fca None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:26.903112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-545be616-14da-498f-b41b-548947519fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:26.967944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7e6a2-25aa-40b8-b1a1-5d3bfbd95192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:26.969034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7e6a2-25aa-40b8-b1a1-5d3bfbd95192 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:26.969569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7e6a2-25aa-40b8-b1a1-5d3bfbd95192 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:26.970208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7e6a2-25aa-40b8-b1a1-5d3bfbd95192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:26.973305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-eba7e6a2-25aa-40b8-b1a1-5d3bfbd95192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:27.006195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7e6a2-25aa-40b8-b1a1-5d3bfbd95192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:27.009384 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7e6a2-25aa-40b8-b1a1-5d3bfbd95192 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:27.011781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545be616-14da-498f-b41b-548947519fca None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:27.015929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1935-e84e-4041-ab30-e977e35abbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:27.016881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1935-e84e-4041-ab30-e977e35abbac service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:27.017246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1935-e84e-4041-ab30-e977e35abbac service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:27.017626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1935-e84e-4041-ab30-e977e35abbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:27.020797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 920/1868] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:27.021647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7e6a2-25aa-40b8-b1a1-5d3bfbd95192 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:27.029133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1935-e84e-4041-ab30-e977e35abbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:27.030739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7e6a2-25aa-40b8-b1a1-5d3bfbd95192 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:27.030861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1935-e84e-4041-ab30-e977e35abbac service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:27.035799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bda13-9577-477b-a0dc-f95769991d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:27.035799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bda13-9577-477b-a0dc-f95769991d92 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:27.036076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bda13-9577-477b-a0dc-f95769991d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:27.036266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bda13-9577-477b-a0dc-f95769991d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:27.044656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 949/1869] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:27.051247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bda13-9577-477b-a0dc-f95769991d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:27.053302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bda13-9577-477b-a0dc-f95769991d92 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:27.066749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 921/1870] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:27.620907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1935-e84e-4041-ab30-e977e35abbac service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:27.622479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d34b1935-e84e-4041-ab30-e977e35abbac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:27.640983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1935-e84e-4041-ab30-e977e35abbac service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:27.646787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:27.648693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:27.648905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:27.649235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] PATH_INFO: `/v3/projects/09f5a4c3f1c84697bd67d25cab61d2fb` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:27.651355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f5a4c3f1c84697bd67d25cab61d2fb)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:27.656073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:27.686275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:27.744321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f5a4c3f1c84697bd67d25cab61d2fb', 'request_id': 'req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:27.754674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f5a4c3f1c84697bd67d25cab61d2fb', 'request_id': 'req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:27.768261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f5a4c3f1c84697bd67d25cab61d2fb', 'request_id': 'req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:27.785096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bda13-9577-477b-a0dc-f95769991d92 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:27.786714 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ba7bda13-9577-477b-a0dc-f95769991d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:27.804579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] The token cache is being invalidate because project 09f5a4c3f1c84697bd67d25cab61d2fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:27.804978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:27.808523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:27.812191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 950/1871] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:27 2022] DELETE /identity/v3/projects/09f5a4c3f1c84697bd67d25cab61d2fb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:27.814164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:27.825320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:27.829047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bda13-9577-477b-a0dc-f95769991d92 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:27.922191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:27.923026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:27.923210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a9d7a-9a2c-4480-b19d-048858c6dc8f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:27.923456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:27.924056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] PATH_INFO: `/v3/projects/39dc44d80cdf4b9cabf795ca12f3a8c7` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:27.925359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=39dc44d80cdf4b9cabf795ca12f3a8c7)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:27.927432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:27.928255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:27.929140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:27.929426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:27.929703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] PATH_INFO: `/v3/projects/e3b2d7c84b5c4d05aa8acfb694cb2b37` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:27.931519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b2d7c84b5c4d05aa8acfb694cb2b37)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:27.933431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:27.995666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39dc44d80cdf4b9cabf795ca12f3a8c7', 'request_id': 'req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.005037 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b2d7c84b5c4d05aa8acfb694cb2b37', 'request_id': 'req-4295f26f-b613-4861-81af-dcd6e8321756'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.009770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39dc44d80cdf4b9cabf795ca12f3a8c7', 'request_id': 'req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.015882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b2d7c84b5c4d05aa8acfb694cb2b37', 'request_id': 'req-4295f26f-b613-4861-81af-dcd6e8321756'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.019112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39dc44d80cdf4b9cabf795ca12f3a8c7', 'request_id': 'req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.029319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b2d7c84b5c4d05aa8acfb694cb2b37', 'request_id': 'req-4295f26f-b613-4861-81af-dcd6e8321756'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.033377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] The token cache is being invalidate because project 39dc44d80cdf4b9cabf795ca12f3a8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:28.033682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.034452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.040305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 922/1872] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:27 2022] DELETE /identity/v3/projects/39dc44d80cdf4b9cabf795ca12f3a8c7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:28.041802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:28.043678 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:28.052470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] The token cache is being invalidate because project e3b2d7c84b5c4d05aa8acfb694cb2b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:28.053605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.054482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.062261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 951/1873] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:27 2022] DELETE /identity/v3/projects/e3b2d7c84b5c4d05aa8acfb694cb2b37 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:28.062261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:28.064504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:28.078774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:28.129058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:28.155249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98c26-9cd3-4035-b785-95ccaebdf1fd admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:28.177634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f26f-b613-4861-81af-dcd6e8321756 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:28.185850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:28.186816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:28.187203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:28.187962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] PATH_INFO: `/v3/users/0f789606385d46168967605f66f7685b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:28.188927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f789606385d46168967605f66f7685b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:28.191239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:28.246403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:28.248120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:28.248120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:28.248695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] PATH_INFO: `/v3/users/81047d212011486194ffa9771d2bc620` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:28.250373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=81047d212011486194ffa9771d2bc620)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:28.253088 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:28.277167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f789606385d46168967605f66f7685b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.300890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f789606385d46168967605f66f7685b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.300890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f789606385d46168967605f66f7685b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.313342 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f789606385d46168967605f66f7685b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.323772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f789606385d46168967605f66f7685b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.328144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81047d212011486194ffa9771d2bc620'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.335732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 952/1874] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:28 2022] DELETE /identity/v3/users/0f789606385d46168967605f66f7685b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:28.335732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:28.335732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:28.355695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81047d212011486194ffa9771d2bc620'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.356953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81047d212011486194ffa9771d2bc620'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.392425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81047d212011486194ffa9771d2bc620'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.410366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81047d212011486194ffa9771d2bc620'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.420513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 923/1875] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:28 2022] DELETE /identity/v3/users/81047d212011486194ffa9771d2bc620 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:28.453229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009656e-5412-4f9e-bc17-0b557996893a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:28.581753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:28.583548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:28.584390 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:28.585004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] PATH_INFO: `/v3/users/118195b6c43d48c3a27bf85152a0b005` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:28.587671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=118195b6c43d48c3a27bf85152a0b005)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:28.591730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:28.595060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:28.674198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118195b6c43d48c3a27bf85152a0b005'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.701231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118195b6c43d48c3a27bf85152a0b005'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.702021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118195b6c43d48c3a27bf85152a0b005'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.712695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118195b6c43d48c3a27bf85152a0b005'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.723802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118195b6c43d48c3a27bf85152a0b005'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:28.732641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 953/1876] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:28 2022] DELETE /identity/v3/users/118195b6c43d48c3a27bf85152a0b005 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:28.777392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:28.778900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:28.794619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7f2cf-359f-4a56-8efd-eb2dc493a31c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:28.841383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:28.844297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:28.885760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:28.919430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:28.921597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:28.922266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:28.922982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] PATH_INFO: `/v3/projects/4a8784a5fcc24011a25025ac09cea592` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:28.924509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8784a5fcc24011a25025ac09cea592)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:28.927002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:28.943281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3d3db-25c5-48c6-bdc3-93a9e723e271 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:28.950644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:28.951805 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:28.952397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:28.952886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] PATH_INFO: `/v3/projects/f4654650b79740c58adeaf404fbeeff5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:28.954572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4654650b79740c58adeaf404fbeeff5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:28.956718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.027188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8784a5fcc24011a25025ac09cea592', 'request_id': 'req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.043970 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8784a5fcc24011a25025ac09cea592', 'request_id': 'req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.052283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8784a5fcc24011a25025ac09cea592', 'request_id': 'req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.066435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] The token cache is being invalidate because project 4a8784a5fcc24011a25025ac09cea592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:29.066832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.067749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34033718-7d17-4d3b-89b2-c4c3bb48fc2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.069891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 924/1877] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:28 2022] DELETE /identity/v3/projects/4a8784a5fcc24011a25025ac09cea592 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:29.075817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26dd6-49e3-459d-9400-e43d6f110c5a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.076729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4654650b79740c58adeaf404fbeeff5', 'request_id': 'req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.078013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26dd6-49e3-459d-9400-e43d6f110c5a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.078983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f26dd6-49e3-459d-9400-e43d6f110c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.092988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4654650b79740c58adeaf404fbeeff5', 'request_id': 'req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.111980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4654650b79740c58adeaf404fbeeff5', 'request_id': 'req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.115849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-74f26dd6-49e3-459d-9400-e43d6f110c5a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:29.117331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-74f26dd6-49e3-459d-9400-e43d6f110c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:29.132258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] The token cache is being invalidate because project f4654650b79740c58adeaf404fbeeff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:29.132562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.133432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d1ea68c-0d07-42a2-9925-fc2ab009f78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:29.136412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 954/1878] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:28 2022] DELETE /identity/v3/projects/f4654650b79740c58adeaf404fbeeff5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:29.141549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebbbec-8254-4de1-b25e-db34eebe78f2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.141846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebbbec-8254-4de1-b25e-db34eebe78f2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.142123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebbbec-8254-4de1-b25e-db34eebe78f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.164825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-22ebbbec-8254-4de1-b25e-db34eebe78f2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:29.166603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-22ebbbec-8254-4de1-b25e-db34eebe78f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:29.172179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:29.219105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 925/1879] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:29.246504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f8a00-66cc-4c63-ad26-217617c80c30 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.248200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f8a00-66cc-4c63-ad26-217617c80c30 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.251149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f8a00-66cc-4c63-ad26-217617c80c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.286672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 955/1880] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:29.293242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbada4-c7b9-4a47-b98d-5dc657d24b93 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.293640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbada4-c7b9-4a47-b98d-5dc657d24b93 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.293775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbada4-c7b9-4a47-b98d-5dc657d24b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.327526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b2dbada4-c7b9-4a47-b98d-5dc657d24b93 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:29.329761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b2dbada4-c7b9-4a47-b98d-5dc657d24b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:29.341672 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 956/1881] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:29.346052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbada4-c7b9-4a47-b98d-5dc657d24b93 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.356844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbada4-c7b9-4a47-b98d-5dc657d24b93 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.362498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ace21-282b-4da5-8959-e76b82b0a666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.363198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ace21-282b-4da5-8959-e76b82b0a666 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.363478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ace21-282b-4da5-8959-e76b82b0a666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.363754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ace21-282b-4da5-8959-e76b82b0a666 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.364499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ace21-282b-4da5-8959-e76b82b0a666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:29.364808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ace21-282b-4da5-8959-e76b82b0a666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.366497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ace21-282b-4da5-8959-e76b82b0a666 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.382933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 957/1882] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:29.389486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ace21-282b-4da5-8959-e76b82b0a666 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.404115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ace21-282b-4da5-8959-e76b82b0a666 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.411024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf614bf-e4ab-4186-8550-bd62b9f4ef46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.411827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf614bf-e4ab-4186-8550-bd62b9f4ef46 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.412219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf614bf-e4ab-4186-8550-bd62b9f4ef46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.412557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf614bf-e4ab-4186-8550-bd62b9f4ef46 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.413401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf614bf-e4ab-4186-8550-bd62b9f4ef46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.415472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf614bf-e4ab-4186-8550-bd62b9f4ef46 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.434886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d10f8a00-66cc-4c63-ad26-217617c80c30 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:29.436120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d10f8a00-66cc-4c63-ad26-217617c80c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:29.451171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 926/1883] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:29.457625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f8a00-66cc-4c63-ad26-217617c80c30 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.466465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 958/1884] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:29 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:29.469797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf614bf-e4ab-4186-8550-bd62b9f4ef46 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.474813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f8a00-66cc-4c63-ad26-217617c80c30 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.570509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf614bf-e4ab-4186-8550-bd62b9f4ef46 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.579480 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb40e56-f636-4d7c-911e-0ab67431805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.580268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb40e56-f636-4d7c-911e-0ab67431805e admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.580554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb40e56-f636-4d7c-911e-0ab67431805e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.580834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb40e56-f636-4d7c-911e-0ab67431805e admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.581815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb40e56-f636-4d7c-911e-0ab67431805e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:29.582824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb40e56-f636-4d7c-911e-0ab67431805e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.583764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225132fd-559e-4a32-b4ae-a97c91012c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.584785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb40e56-f636-4d7c-911e-0ab67431805e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.590514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225132fd-559e-4a32-b4ae-a97c91012c06 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.590514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225132fd-559e-4a32-b4ae-a97c91012c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.590514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225132fd-559e-4a32-b4ae-a97c91012c06 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.590514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225132fd-559e-4a32-b4ae-a97c91012c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.592379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225132fd-559e-4a32-b4ae-a97c91012c06 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.609314 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 927/1885] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:51:29.615590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb40e56-f636-4d7c-911e-0ab67431805e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.630522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:29.639617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 959/1886] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:29 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:29.641150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225132fd-559e-4a32-b4ae-a97c91012c06 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.649364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb40e56-f636-4d7c-911e-0ab67431805e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.658019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f327d-5c26-448a-8da8-1e0b8d75a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.659221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f327d-5c26-448a-8da8-1e0b8d75a924 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.660100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f327d-5c26-448a-8da8-1e0b8d75a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.660419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225132fd-559e-4a32-b4ae-a97c91012c06 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.660782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f327d-5c26-448a-8da8-1e0b8d75a924 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.662081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f327d-5c26-448a-8da8-1e0b8d75a924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.665702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f327d-5c26-448a-8da8-1e0b8d75a924 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.669380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15275f-1ae4-40a4-a6d5-02d87168c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.672645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15275f-1ae4-40a4-a6d5-02d87168c65e admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.673006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15275f-1ae4-40a4-a6d5-02d87168c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.673271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15275f-1ae4-40a4-a6d5-02d87168c65e admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.675992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15275f-1ae4-40a4-a6d5-02d87168c65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.678160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15275f-1ae4-40a4-a6d5-02d87168c65e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.692604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 960/1887] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:29.698914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15275f-1ae4-40a4-a6d5-02d87168c65e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.714685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15275f-1ae4-40a4-a6d5-02d87168c65e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.715708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 928/1888] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:29 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:29.719572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f327d-5c26-448a-8da8-1e0b8d75a924 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.803300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:29.839883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91c347-c281-47a4-be22-2fdb49fa8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.841114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91c347-c281-47a4-be22-2fdb49fa8744 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.841297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91c347-c281-47a4-be22-2fdb49fa8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.841583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91c347-c281-47a4-be22-2fdb49fa8744 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.842705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91c347-c281-47a4-be22-2fdb49fa8744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.844407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f327d-5c26-448a-8da8-1e0b8d75a924 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.844901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91c347-c281-47a4-be22-2fdb49fa8744 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.852876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5097d-1f46-43b7-a5e1-60aa9e0eecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.854090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5097d-1f46-43b7-a5e1-60aa9e0eecc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.854643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5097d-1f46-43b7-a5e1-60aa9e0eecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.855179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5097d-1f46-43b7-a5e1-60aa9e0eecc6 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.856379 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5097d-1f46-43b7-a5e1-60aa9e0eecc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.857954 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 961/1889] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:29.859062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91c347-c281-47a4-be22-2fdb49fa8744 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.864752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5097d-1f46-43b7-a5e1-60aa9e0eecc6 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.865555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6d91c347-c281-47a4-be22-2fdb49fa8744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:29.894591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91c347-c281-47a4-be22-2fdb49fa8744 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.902066 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 929/1890] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:29 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:29.904746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5097d-1f46-43b7-a5e1-60aa9e0eecc6 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:29.912920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.914002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.914606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.915431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] PATH_INFO: `/v3/projects/1935be888ebc4c0894609c0eab6bb05d` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.925905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1935be888ebc4c0894609c0eab6bb05d)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.927981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:29.931165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5097d-1f46-43b7-a5e1-60aa9e0eecc6 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:29.939524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e77b4e-ebf8-4d97-8222-7820e9bc19c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:29.948337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e77b4e-ebf8-4d97-8222-7820e9bc19c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:29.948933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e77b4e-ebf8-4d97-8222-7820e9bc19c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:29.949508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e77b4e-ebf8-4d97-8222-7820e9bc19c6 admin admin] PATH_INFO: `/v3/projects/799d5e52506e4b6aa988eb440a0328e4/users/152543c8a3294367af93d7d0b1508789/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:29.990769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e77b4e-ebf8-4d97-8222-7820e9bc19c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799d5e52506e4b6aa988eb440a0328e4, user_id=152543c8a3294367af93d7d0b1508789, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:29.998620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e77b4e-ebf8-4d97-8222-7820e9bc19c6 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.045428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 930/1891] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:29 2022] PUT /identity/v3/projects/799d5e52506e4b6aa988eb440a0328e4/users/152543c8a3294367af93d7d0b1508789/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:30.048022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e77b4e-ebf8-4d97-8222-7820e9bc19c6 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.073023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1935be888ebc4c0894609c0eab6bb05d', 'request_id': 'req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:30.088960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1935be888ebc4c0894609c0eab6bb05d', 'request_id': 'req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:30.109699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1935be888ebc4c0894609c0eab6bb05d', 'request_id': 'req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:30.130430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] The token cache is being invalidate because project 1935be888ebc4c0894609c0eab6bb05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:30.131964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:30.133537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f1b8e52f-b634-4dc8-bfc7-10d45e4010ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:30.137391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 962/1892] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:29 2022] DELETE /identity/v3/projects/1935be888ebc4c0894609c0eab6bb05d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:30.144850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcfe5e-b7fc-4807-96b3-85c1ad50ea9c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.145116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcfe5e-b7fc-4807-96b3-85c1ad50ea9c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.145410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcfe5e-b7fc-4807-96b3-85c1ad50ea9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.177704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e77b4e-ebf8-4d97-8222-7820e9bc19c6 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.180236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-f6bcfe5e-b7fc-4807-96b3-85c1ad50ea9c None None] MFA Rules not processed for user `152543c8a3294367af93d7d0b1508789`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:30.182193 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f6bcfe5e-b7fc-4807-96b3-85c1ad50ea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:30.247602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:30.266619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e97b-a462-4d00-8874-10d95f67f1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.267672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e97b-a462-4d00-8874-10d95f67f1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.268124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e97b-a462-4d00-8874-10d95f67f1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.268562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e97b-a462-4d00-8874-10d95f67f1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.269691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05e97b-a462-4d00-8874-10d95f67f1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.273964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05e97b-a462-4d00-8874-10d95f67f1b1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.297183 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 931/1893] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:30.298139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 963/1894] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:30.299295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17934b-a585-4862-bd90-cdd5f37259c6 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.299733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17934b-a585-4862-bd90-cdd5f37259c6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.300779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17934b-a585-4862-bd90-cdd5f37259c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.304783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcfe5e-b7fc-4807-96b3-85c1ad50ea9c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.306682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f6bcfe5e-b7fc-4807-96b3-85c1ad50ea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:30.324591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcfe5e-b7fc-4807-96b3-85c1ad50ea9c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.327999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-8a17934b-a585-4862-bd90-cdd5f37259c6 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:30.329955 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8a17934b-a585-4862-bd90-cdd5f37259c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:30.330557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f4726-b98e-4171-be6f-2fc442bea136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.331259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f4726-b98e-4171-be6f-2fc442bea136 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.332046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f4726-b98e-4171-be6f-2fc442bea136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.332046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f4726-b98e-4171-be6f-2fc442bea136 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.332578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f4726-b98e-4171-be6f-2fc442bea136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.334550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f4726-b98e-4171-be6f-2fc442bea136 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.345001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 932/1895] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:30.346668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17934b-a585-4862-bd90-cdd5f37259c6 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.353945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8a17934b-a585-4862-bd90-cdd5f37259c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:30.371936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 964/1896] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:30 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:30.374694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b9833-0b0d-4387-ac5a-cf3a653c6d1f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.375814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b9833-0b0d-4387-ac5a-cf3a653c6d1f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.376326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b9833-0b0d-4387-ac5a-cf3a653c6d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.378235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17934b-a585-4862-bd90-cdd5f37259c6 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.406616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-433b9833-0b0d-4387-ac5a-cf3a653c6d1f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:30.407874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-433b9833-0b0d-4387-ac5a-cf3a653c6d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:30.454987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:30.477080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b453556-7544-405c-8540-fb5888119a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.478345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b453556-7544-405c-8540-fb5888119a8b admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.479209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b453556-7544-405c-8540-fb5888119a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.479495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b453556-7544-405c-8540-fb5888119a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.480279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b453556-7544-405c-8540-fb5888119a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.482550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b453556-7544-405c-8540-fb5888119a8b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.504512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 933/1897] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:30.504512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b453556-7544-405c-8540-fb5888119a8b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.504806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 965/1898] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:30.504806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b9833-0b0d-4387-ac5a-cf3a653c6d1f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.516999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b453556-7544-405c-8540-fb5888119a8b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.517570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b9833-0b0d-4387-ac5a-cf3a653c6d1f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.521805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd279-e1c4-404d-b546-38148ef5a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.522526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd279-e1c4-404d-b546-38148ef5a86b admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.522806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd279-e1c4-404d-b546-38148ef5a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.523077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd279-e1c4-404d-b546-38148ef5a86b admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.523320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1eee4-b270-4b93-810c-de69761e946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.523782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cd279-e1c4-404d-b546-38148ef5a86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.524995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1eee4-b270-4b93-810c-de69761e946b admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.525364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1eee4-b270-4b93-810c-de69761e946b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.525733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1eee4-b270-4b93-810c-de69761e946b admin admin] PATH_INFO: `/v3/projects/c4ee7ec0247d45b3b151115c4ca9febc/users/dd73ef0ae3644b22869a52da54d1f64b/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.526650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cd279-e1c4-404d-b546-38148ef5a86b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.554521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1eee4-b270-4b93-810c-de69761e946b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ee7ec0247d45b3b151115c4ca9febc, user_id=dd73ef0ae3644b22869a52da54d1f64b, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.557716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1eee4-b270-4b93-810c-de69761e946b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.559439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 934/1899] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:30 2022] POST /identity/v3/users => generated 291 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:30.561982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd279-e1c4-404d-b546-38148ef5a86b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.583586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd279-e1c4-404d-b546-38148ef5a86b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.584926 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 966/1900] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:30 2022] PUT /identity/v3/projects/c4ee7ec0247d45b3b151115c4ca9febc/users/dd73ef0ae3644b22869a52da54d1f64b/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:30.586011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1eee4-b270-4b93-810c-de69761e946b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.674264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1eee4-b270-4b93-810c-de69761e946b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.683817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05475f99-c4da-4280-8a86-3186957a49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.684597 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475f99-c4da-4280-8a86-3186957a49c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.684930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475f99-c4da-4280-8a86-3186957a49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.685274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475f99-c4da-4280-8a86-3186957a49c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.686245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05475f99-c4da-4280-8a86-3186957a49c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.688004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05475f99-c4da-4280-8a86-3186957a49c8 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.699131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a7ad-28eb-4b1b-9095-bfcfe58f7659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.700717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a7ad-28eb-4b1b-9095-bfcfe58f7659 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.700857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 967/1901] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:30.701287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a7ad-28eb-4b1b-9095-bfcfe58f7659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.701719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2a7ad-28eb-4b1b-9095-bfcfe58f7659 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.702317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c74fa-aab2-4869-a111-4de3bf441714 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.702593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c74fa-aab2-4869-a111-4de3bf441714 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.702879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c74fa-aab2-4869-a111-4de3bf441714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.703763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2a7ad-28eb-4b1b-9095-bfcfe58f7659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:30.704225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2a7ad-28eb-4b1b-9095-bfcfe58f7659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.706608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2a7ad-28eb-4b1b-9095-bfcfe58f7659 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.723711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 935/1902] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:30.724855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a7ad-28eb-4b1b-9095-bfcfe58f7659 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.737715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-149c74fa-aab2-4869-a111-4de3bf441714 None None] MFA Rules not processed for user `dd73ef0ae3644b22869a52da54d1f64b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:30.739003 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-149c74fa-aab2-4869-a111-4de3bf441714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:30.740375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2a7ad-28eb-4b1b-9095-bfcfe58f7659 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.746760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580df3-7609-4bdb-a1b2-b1e8a76cd2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.747785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580df3-7609-4bdb-a1b2-b1e8a76cd2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.748116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580df3-7609-4bdb-a1b2-b1e8a76cd2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.748371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580df3-7609-4bdb-a1b2-b1e8a76cd2e2 admin admin] PATH_INFO: `/v3/projects/47946993fca14cdeb2ab8a9f2d7da17e/users/453f53ca36584dbb8299c034c29d390b/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.768911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580df3-7609-4bdb-a1b2-b1e8a76cd2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47946993fca14cdeb2ab8a9f2d7da17e, user_id=453f53ca36584dbb8299c034c29d390b, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.772044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580df3-7609-4bdb-a1b2-b1e8a76cd2e2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.794707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 936/1903] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:30 2022] PUT /identity/v3/projects/47946993fca14cdeb2ab8a9f2d7da17e/users/453f53ca36584dbb8299c034c29d390b/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:30.795986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580df3-7609-4bdb-a1b2-b1e8a76cd2e2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.822422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 968/1904] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:30.826549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c74fa-aab2-4869-a111-4de3bf441714 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.836279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:30.838856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c74fa-aab2-4869-a111-4de3bf441714 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.873785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580df3-7609-4bdb-a1b2-b1e8a76cd2e2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:30.880987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac4bb6-3a0c-49c4-a5a1-d4a5e7478d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.882952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4bb6-3a0c-49c4-a5a1-d4a5e7478d63 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.883943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4bb6-3a0c-49c4-a5a1-d4a5e7478d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.884384 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4bb6-3a0c-49c4-a5a1-d4a5e7478d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.885447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac4bb6-3a0c-49c4-a5a1-d4a5e7478d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.888986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac4bb6-3a0c-49c4-a5a1-d4a5e7478d63 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.898576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:30.927694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 937/1905] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:30 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:30.928499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac4bb6-3a0c-49c4-a5a1-d4a5e7478d63 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.936237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cb3ca-ecba-4782-b67a-d22e7c39b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:30.936822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cb3ca-ecba-4782-b67a-d22e7c39b10c admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:30.937108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cb3ca-ecba-4782-b67a-d22e7c39b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:30.937391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cb3ca-ecba-4782-b67a-d22e7c39b10c admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:30.938139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cb3ca-ecba-4782-b67a-d22e7c39b10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:30.939793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cb3ca-ecba-4782-b67a-d22e7c39b10c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:30.952616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 969/1906] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:30.954221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cb3ca-ecba-4782-b67a-d22e7c39b10c admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:30.965404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cb3ca-ecba-4782-b67a-d22e7c39b10c admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.016601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac4bb6-3a0c-49c4-a5a1-d4a5e7478d63 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.021718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145e95c-2dd8-4010-b9d5-53a70f7c64b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.022356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145e95c-2dd8-4010-b9d5-53a70f7c64b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.022678 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145e95c-2dd8-4010-b9d5-53a70f7c64b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.022958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145e95c-2dd8-4010-b9d5-53a70f7c64b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.023664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145e95c-2dd8-4010-b9d5-53a70f7c64b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.025731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145e95c-2dd8-4010-b9d5-53a70f7c64b0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.035511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a0aa-7f47-42ec-9739-1cec991bdcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.036225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a0aa-7f47-42ec-9739-1cec991bdcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.036512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a0aa-7f47-42ec-9739-1cec991bdcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.036801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a0aa-7f47-42ec-9739-1cec991bdcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.037491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554a0aa-7f47-42ec-9739-1cec991bdcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.039704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554a0aa-7f47-42ec-9739-1cec991bdcd8 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.058135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 938/1907] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:30 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:31.061790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145e95c-2dd8-4010-b9d5-53a70f7c64b0 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.068665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 970/1908] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:30 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:31.068665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a0aa-7f47-42ec-9739-1cec991bdcd8 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.093895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a0aa-7f47-42ec-9739-1cec991bdcd8 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.145779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145e95c-2dd8-4010-b9d5-53a70f7c64b0 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.154809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d9d8-6034-4115-8312-7b16f9377860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.155907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d9d8-6034-4115-8312-7b16f9377860 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.156210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d9d8-6034-4115-8312-7b16f9377860 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.156480 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d9d8-6034-4115-8312-7b16f9377860 admin admin] PATH_INFO: `/v3/projects/47946993fca14cdeb2ab8a9f2d7da17e/users/453f53ca36584dbb8299c034c29d390b/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.158596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d9d8-6034-4115-8312-7b16f9377860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47946993fca14cdeb2ab8a9f2d7da17e, user_id=453f53ca36584dbb8299c034c29d390b, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.161557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d9d8-6034-4115-8312-7b16f9377860 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.182417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 939/1909] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:31 2022] PUT /identity/v3/projects/47946993fca14cdeb2ab8a9f2d7da17e/users/453f53ca36584dbb8299c034c29d390b/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:31.191999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d9d8-6034-4115-8312-7b16f9377860 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.202231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb0876-bcae-4883-aef6-1dd7eb6a0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.205195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0876-bcae-4883-aef6-1dd7eb6a0889 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.206361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0876-bcae-4883-aef6-1dd7eb6a0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.208473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0876-bcae-4883-aef6-1dd7eb6a0889 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.209922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb0876-bcae-4883-aef6-1dd7eb6a0889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.217360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb0876-bcae-4883-aef6-1dd7eb6a0889 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.248335 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 971/1910] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:31 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:31.254418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371d240-f622-4fc9-a24d-a4866eb0c2d6 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.256008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371d240-f622-4fc9-a24d-a4866eb0c2d6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.256008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371d240-f622-4fc9-a24d-a4866eb0c2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.273381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:31.294740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e371d240-f622-4fc9-a24d-a4866eb0c2d6 None None] MFA Rules not processed for user `453f53ca36584dbb8299c034c29d390b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:31.303698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e371d240-f622-4fc9-a24d-a4866eb0c2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:31.322836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d9d8-6034-4115-8312-7b16f9377860 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.336710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccb1f8-47bc-40bc-8f39-9d0e175382fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.340294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb1f8-47bc-40bc-8f39-9d0e175382fa admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.340741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb1f8-47bc-40bc-8f39-9d0e175382fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.346541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccb1f8-47bc-40bc-8f39-9d0e175382fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.347512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccb1f8-47bc-40bc-8f39-9d0e175382fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.349610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccb1f8-47bc-40bc-8f39-9d0e175382fa admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.382526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 940/1911] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:31.382526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccb1f8-47bc-40bc-8f39-9d0e175382fa admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.397905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:31.400860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccb1f8-47bc-40bc-8f39-9d0e175382fa admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.407674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67db03-900c-4e73-9d2a-56bbc7b836e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.408482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67db03-900c-4e73-9d2a-56bbc7b836e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.408866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67db03-900c-4e73-9d2a-56bbc7b836e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.409576 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67db03-900c-4e73-9d2a-56bbc7b836e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.410566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67db03-900c-4e73-9d2a-56bbc7b836e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.412821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67db03-900c-4e73-9d2a-56bbc7b836e5 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.435431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 941/1912] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:31.436592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67db03-900c-4e73-9d2a-56bbc7b836e5 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.459395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67db03-900c-4e73-9d2a-56bbc7b836e5 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.466259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3043e-3c54-4b64-9342-19f9c5782057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.467351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3043e-3c54-4b64-9342-19f9c5782057 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.467943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3043e-3c54-4b64-9342-19f9c5782057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.468170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3043e-3c54-4b64-9342-19f9c5782057 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.468787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3043e-3c54-4b64-9342-19f9c5782057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.471011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3043e-3c54-4b64-9342-19f9c5782057 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.479725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 972/1913] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:31.479725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371d240-f622-4fc9-a24d-a4866eb0c2d6 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.483897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 942/1914] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:31.491059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3043e-3c54-4b64-9342-19f9c5782057 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.496255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a7f3043e-3c54-4b64-9342-19f9c5782057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:31.508762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371d240-f622-4fc9-a24d-a4866eb0c2d6 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.516147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1c920-6543-40fb-a7fd-bcab46276943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.518118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1c920-6543-40fb-a7fd-bcab46276943 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.519188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1c920-6543-40fb-a7fd-bcab46276943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.519474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1c920-6543-40fb-a7fd-bcab46276943 admin admin] PATH_INFO: `/v3/projects/23a6731884e347dfbd8d73898721a120/users/6db6aed3e6214ea19b1c5b6759a76c65/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.546419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1c920-6543-40fb-a7fd-bcab46276943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a6731884e347dfbd8d73898721a120, user_id=6db6aed3e6214ea19b1c5b6759a76c65, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.549681 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1c920-6543-40fb-a7fd-bcab46276943 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.571226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 973/1915] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:31 2022] PUT /identity/v3/projects/23a6731884e347dfbd8d73898721a120/users/6db6aed3e6214ea19b1c5b6759a76c65/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:31.576795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1c920-6543-40fb-a7fd-bcab46276943 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.609995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3043e-3c54-4b64-9342-19f9c5782057 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.669133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1c920-6543-40fb-a7fd-bcab46276943 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.676287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751db57c-fef5-4099-95e9-bdfc4c9325c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.677845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751db57c-fef5-4099-95e9-bdfc4c9325c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.678642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751db57c-fef5-4099-95e9-bdfc4c9325c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.679128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751db57c-fef5-4099-95e9-bdfc4c9325c7 admin admin] PATH_INFO: `/v3/projects/8e4c140ec2cc40619cd5f75a576bf0d1/users/a98f1e9031ef45a988f2a9114a81f114/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.698991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393e92f-6617-4712-b18a-5320208170fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.699391 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393e92f-6617-4712-b18a-5320208170fc service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.699681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393e92f-6617-4712-b18a-5320208170fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.699960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393e92f-6617-4712-b18a-5320208170fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.710969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751db57c-fef5-4099-95e9-bdfc4c9325c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4c140ec2cc40619cd5f75a576bf0d1, user_id=a98f1e9031ef45a988f2a9114a81f114, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.717505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751db57c-fef5-4099-95e9-bdfc4c9325c7 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.743735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 974/1916] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:31 2022] PUT /identity/v3/projects/8e4c140ec2cc40619cd5f75a576bf0d1/users/a98f1e9031ef45a988f2a9114a81f114/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:31.745305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751db57c-fef5-4099-95e9-bdfc4c9325c7 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.845027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751db57c-fef5-4099-95e9-bdfc4c9325c7 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.849195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393e92f-6617-4712-b18a-5320208170fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.851365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca1dd-44ea-47bf-bb0f-fe7547674ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.851733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393e92f-6617-4712-b18a-5320208170fc service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.852071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca1dd-44ea-47bf-bb0f-fe7547674ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.852927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca1dd-44ea-47bf-bb0f-fe7547674ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.853211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca1dd-44ea-47bf-bb0f-fe7547674ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.853965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eca1dd-44ea-47bf-bb0f-fe7547674ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.855666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eca1dd-44ea-47bf-bb0f-fe7547674ad9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.872612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 943/1917] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:31.875344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5afdf3-554b-41ec-a99c-1ef2402f1f0b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.876287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5afdf3-554b-41ec-a99c-1ef2402f1f0b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.876287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5afdf3-554b-41ec-a99c-1ef2402f1f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.885571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 975/1918] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:31.886628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca1dd-44ea-47bf-bb0f-fe7547674ad9 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.917436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca1dd-44ea-47bf-bb0f-fe7547674ad9 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:31.936001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438f1f9-9ca7-4e2b-bfcc-cd6beabdf113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:31.936716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-bc5afdf3-554b-41ec-a99c-1ef2402f1f0b None None] MFA Rules not processed for user `a98f1e9031ef45a988f2a9114a81f114`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:31.936940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f1f9-9ca7-4e2b-bfcc-cd6beabdf113 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:31.937207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f1f9-9ca7-4e2b-bfcc-cd6beabdf113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:31.937489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f1f9-9ca7-4e2b-bfcc-cd6beabdf113 admin admin] PATH_INFO: `/v3/projects/23a6731884e347dfbd8d73898721a120/users/6db6aed3e6214ea19b1c5b6759a76c65/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:31.939360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-bc5afdf3-554b-41ec-a99c-1ef2402f1f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:31.941494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438f1f9-9ca7-4e2b-bfcc-cd6beabdf113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a6731884e347dfbd8d73898721a120, user_id=6db6aed3e6214ea19b1c5b6759a76c65, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:31.944681 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438f1f9-9ca7-4e2b-bfcc-cd6beabdf113 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:31.947731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:31.971186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 976/1919] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:31 2022] PUT /identity/v3/projects/23a6731884e347dfbd8d73898721a120/users/6db6aed3e6214ea19b1c5b6759a76c65/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:31.972101 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438f1f9-9ca7-4e2b-bfcc-cd6beabdf113 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:31.974084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6438f1f9-9ca7-4e2b-bfcc-cd6beabdf113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:32.012036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:32.074241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 944/1920] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:32.074241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43365-c0e4-443f-b7ef-1361236399b6 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:32.074241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43365-c0e4-443f-b7ef-1361236399b6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:32.074241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43365-c0e4-443f-b7ef-1361236399b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:32.106305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-69f43365-c0e4-443f-b7ef-1361236399b6 None None] MFA Rules not processed for user `6db6aed3e6214ea19b1c5b6759a76c65`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:32.107779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-69f43365-c0e4-443f-b7ef-1361236399b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:32.113964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438f1f9-9ca7-4e2b-bfcc-cd6beabdf113 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:32.130973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74350b71-d629-4a42-9fde-bb52f678c781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:32.132052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74350b71-d629-4a42-9fde-bb52f678c781 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:32.132519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74350b71-d629-4a42-9fde-bb52f678c781 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:32.134360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74350b71-d629-4a42-9fde-bb52f678c781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:32.229229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 945/1921] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:32.241584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f43365-c0e4-443f-b7ef-1361236399b6 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:32.243319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-69f43365-c0e4-443f-b7ef-1361236399b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:32.277210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74350b71-d629-4a42-9fde-bb52f678c781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:32.280826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74350b71-d629-4a42-9fde-bb52f678c781 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:32.299430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 977/1922] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:32.300897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74350b71-d629-4a42-9fde-bb52f678c781 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:32.320531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74350b71-d629-4a42-9fde-bb52f678c781 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:32.340696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55da87-4213-4ea2-b91c-17395d4634f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:32.342090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55da87-4213-4ea2-b91c-17395d4634f0 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:32.342652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55da87-4213-4ea2-b91c-17395d4634f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:32.343159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55da87-4213-4ea2-b91c-17395d4634f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:32.361638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f43365-c0e4-443f-b7ef-1361236399b6 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:32.370768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7a2ac-c7dd-4df7-804a-cd47717ef5a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb359ac9b084b38b77923219f42f655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:32.372779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7a2ac-c7dd-4df7-804a-cd47717ef5a0 service glance] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:32.373587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7a2ac-c7dd-4df7-804a-cd47717ef5a0 service glance] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:32.374430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7a2ac-c7dd-4df7-804a-cd47717ef5a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:32.382127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55da87-4213-4ea2-b91c-17395d4634f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:32.386706 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55da87-4213-4ea2-b91c-17395d4634f0 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:32.424493 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 978/1923] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:32.495656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:32.527383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55da87-4213-4ea2-b91c-17395d4634f0 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:32.534276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7a2ac-c7dd-4df7-804a-cd47717ef5a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:32.537935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7a2ac-c7dd-4df7-804a-cd47717ef5a0 service glance] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:32.551457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55da87-4213-4ea2-b91c-17395d4634f0 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:32.559880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 946/1924] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:32.566702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177a700-1eca-4005-833a-c7cb26bae7d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:32.571196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177a700-1eca-4005-833a-c7cb26bae7d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:32.572099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177a700-1eca-4005-833a-c7cb26bae7d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:32.572857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177a700-1eca-4005-833a-c7cb26bae7d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:32.718160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177a700-1eca-4005-833a-c7cb26bae7d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:32.720752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177a700-1eca-4005-833a-c7cb26bae7d9 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:32.735708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 979/1925] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:35.651232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f037a9-e98e-4d81-9f63-35162c0d6e7d None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:35.652096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f037a9-e98e-4d81-9f63-35162c0d6e7d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:35.652865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f037a9-e98e-4d81-9f63-35162c0d6e7d None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:35.655535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 947/1926] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:51:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:35.673916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c177df0-1d80-45cb-974c-6b08436c5c09 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:35.674732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c177df0-1d80-45cb-974c-6b08436c5c09 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:35.675112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c177df0-1d80-45cb-974c-6b08436c5c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:35.706544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1c177df0-1d80-45cb-974c-6b08436c5c09 None None] MFA Rules not processed for user `167e32465f314f4caf9f8df4a4710dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:35.709935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1c177df0-1d80-45cb-974c-6b08436c5c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:35.817797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f037a9-e98e-4d81-9f63-35162c0d6e7d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:35.820910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-36f037a9-e98e-4d81-9f63-35162c0d6e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:35.928154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:35.961268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 980/1927] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:51:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:35.982587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c177df0-1d80-45cb-974c-6b08436c5c09 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:35.985548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1c177df0-1d80-45cb-974c-6b08436c5c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:36.012983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c177df0-1d80-45cb-974c-6b08436c5c09 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:36.023438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cea59d-f90b-4d83-933f-654f014b776c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:36.024901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cea59d-f90b-4d83-933f-654f014b776c service placement] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:36.025550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cea59d-f90b-4d83-933f-654f014b776c service placement] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:36.026024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cea59d-f90b-4d83-933f-654f014b776c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:36.046452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cea59d-f90b-4d83-933f-654f014b776c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:36.049987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cea59d-f90b-4d83-933f-654f014b776c service placement] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:36.058158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f037a9-e98e-4d81-9f63-35162c0d6e7d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:36.070282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:36.072792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:36.074553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:36.075195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] PATH_INFO: `/v3/users/ccb309041aee42d49b2e9b992a6a87d1` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:36.077305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 981/1928] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:36.080340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb309041aee42d49b2e9b992a6a87d1)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:36.088551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:36.166986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb309041aee42d49b2e9b992a6a87d1'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:36.198707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb309041aee42d49b2e9b992a6a87d1'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:36.199593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb309041aee42d49b2e9b992a6a87d1'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:36.215899 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb309041aee42d49b2e9b992a6a87d1'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:36.229279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-bf236d0e-9b98-4075-ba88-4fbe660eee17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb309041aee42d49b2e9b992a6a87d1'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:36.239512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 948/1929] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:35 2022] DELETE /identity/v3/users/ccb309041aee42d49b2e9b992a6a87d1 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:36.819256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cea59d-f90b-4d83-933f-654f014b776c service placement] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:36.856936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cea59d-f90b-4d83-933f-654f014b776c service placement] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:36.998447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:36.999974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.000391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.000792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] PATH_INFO: `/v3/projects/5a4b6ef620e14095a29b907746decc8b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.002618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4b6ef620e14095a29b907746decc8b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:37.005679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:37.108056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4b6ef620e14095a29b907746decc8b', 'request_id': 'req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.123208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4b6ef620e14095a29b907746decc8b', 'request_id': 'req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.144455 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4b6ef620e14095a29b907746decc8b', 'request_id': 'req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.180686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] The token cache is being invalidate because project 5a4b6ef620e14095a29b907746decc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:37.181582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.183204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.188249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 982/1930] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:36 2022] DELETE /identity/v3/projects/5a4b6ef620e14095a29b907746decc8b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:37.195247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c484-7dab-4c7b-8472-450bcadcc177 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.196447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c484-7dab-4c7b-8472-450bcadcc177 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.196622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c484-7dab-4c7b-8472-450bcadcc177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.232038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-4096c484-7dab-4c7b-8472-450bcadcc177 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:37.234734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4096c484-7dab-4c7b-8472-450bcadcc177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:37.321440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:37.324207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:37.330547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 949/1931] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:37.339500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117e4d7-17eb-468e-8fe0-ecac07f2e6a3 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.340175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117e4d7-17eb-468e-8fe0-ecac07f2e6a3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.340715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117e4d7-17eb-468e-8fe0-ecac07f2e6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.346438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c13e-c216-4348-8aa2-1c6a084ed8e5 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:37.349795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:37.354978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:37.356510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.357239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.357775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] PATH_INFO: `/v3/users/152543c8a3294367af93d7d0b1508789` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.360782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152543c8a3294367af93d7d0b1508789)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:37.364599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:37.368483 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-5117e4d7-17eb-468e-8fe0-ecac07f2e6a3 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:37.371142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5117e4d7-17eb-468e-8fe0-ecac07f2e6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:37.381004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 950/1932] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:37.385846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117e4d7-17eb-468e-8fe0-ecac07f2e6a3 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:37.395526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117e4d7-17eb-468e-8fe0-ecac07f2e6a3 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:37.401377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25876a8f-b183-4af6-a9d0-4f694578f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:37.402364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25876a8f-b183-4af6-a9d0-4f694578f31f admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.403072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25876a8f-b183-4af6-a9d0-4f694578f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.403387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25876a8f-b183-4af6-a9d0-4f694578f31f admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.404248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25876a8f-b183-4af6-a9d0-4f694578f31f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:37.404560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25876a8f-b183-4af6-a9d0-4f694578f31f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:37.406290 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25876a8f-b183-4af6-a9d0-4f694578f31f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:37.425509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 951/1933] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:51:37.430295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25876a8f-b183-4af6-a9d0-4f694578f31f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:37.453879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152543c8a3294367af93d7d0b1508789'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.454777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25876a8f-b183-4af6-a9d0-4f694578f31f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:37.463882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1fe26-dde8-4736-b635-3834f8decff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:37.464981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1fe26-dde8-4736-b635-3834f8decff9 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.465438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1fe26-dde8-4736-b635-3834f8decff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.465904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1fe26-dde8-4736-b635-3834f8decff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.467163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1fe26-dde8-4736-b635-3834f8decff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:37.473664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1fe26-dde8-4736-b635-3834f8decff9 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:37.485896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152543c8a3294367af93d7d0b1508789'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.487528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152543c8a3294367af93d7d0b1508789'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.490282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:37.507075 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152543c8a3294367af93d7d0b1508789'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.515997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 952/1934] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:37 2022] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:37.522836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1fe26-dde8-4736-b635-3834f8decff9 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:37.525328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a0c1fe26-dde8-4736-b635-3834f8decff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:37.527206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-50055c7a-2057-40ab-b7e2-caea8ec39318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152543c8a3294367af93d7d0b1508789'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:37.545711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 983/1935] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:37 2022] DELETE /identity/v3/users/152543c8a3294367af93d7d0b1508789 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:37.551952 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a17299-d89e-4fc4-8fd2-39050c472096 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.551952 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a17299-d89e-4fc4-8fd2-39050c472096 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.552643 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a17299-d89e-4fc4-8fd2-39050c472096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.602460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-11a17299-d89e-4fc4-8fd2-39050c472096 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:37.604864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-11a17299-d89e-4fc4-8fd2-39050c472096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:37.704262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1fe26-dde8-4736-b635-3834f8decff9 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:37.756236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 984/1936] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:37.768212 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a17299-d89e-4fc4-8fd2-39050c472096 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:37.772530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-11a17299-d89e-4fc4-8fd2-39050c472096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:37.887860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f13e1b-f2ad-4d5a-acd1-645ffbd218a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:37.889115 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f13e1b-f2ad-4d5a-acd1-645ffbd218a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.889558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f13e1b-f2ad-4d5a-acd1-645ffbd218a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.890100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f13e1b-f2ad-4d5a-acd1-645ffbd218a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.891678 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f13e1b-f2ad-4d5a-acd1-645ffbd218a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:37.896034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f13e1b-f2ad-4d5a-acd1-645ffbd218a3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:37.944956 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 953/1937] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:37 2022] POST /identity/v3/users => generated 284 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:37.951623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f13e1b-f2ad-4d5a-acd1-645ffbd218a3 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:37.959497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a17299-d89e-4fc4-8fd2-39050c472096 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:37.969506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f13e1b-f2ad-4d5a-acd1-645ffbd218a3 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:37.970152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26b4c6-9377-43b0-abdd-856a6d77f640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:37.971330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26b4c6-9377-43b0-abdd-856a6d77f640 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.971915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26b4c6-9377-43b0-abdd-856a6d77f640 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.972543 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26b4c6-9377-43b0-abdd-856a6d77f640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.987093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9a64b-3bd0-4eba-9191-9fd0052a4747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:37.987093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9a64b-3bd0-4eba-9191-9fd0052a4747 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:37.987093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9a64b-3bd0-4eba-9191-9fd0052a4747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:37.987093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9a64b-3bd0-4eba-9191-9fd0052a4747 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:37.987673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9a64b-3bd0-4eba-9191-9fd0052a4747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:37.987673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9a64b-3bd0-4eba-9191-9fd0052a4747 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:38.003277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26b4c6-9377-43b0-abdd-856a6d77f640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:38.005883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26b4c6-9377-43b0-abdd-856a6d77f640 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:38.014709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 954/1938] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:38.016458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9a64b-3bd0-4eba-9191-9fd0052a4747 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:38.022429 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a4e9a64b-3bd0-4eba-9191-9fd0052a4747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:38.032529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 985/1939] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:38.033634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26b4c6-9377-43b0-abdd-856a6d77f640 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:38.048123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9a64b-3bd0-4eba-9191-9fd0052a4747 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:38.061791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:38.061791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:38.061791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:38.061791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] PATH_INFO: `/v3/users/dd73ef0ae3644b22869a52da54d1f64b` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:38.064394 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd73ef0ae3644b22869a52da54d1f64b)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:38.066774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26b4c6-9377-43b0-abdd-856a6d77f640 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:38.068828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:38.074077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb655f4-e7e9-4238-8fa5-e518bd231aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:38.075098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb655f4-e7e9-4238-8fa5-e518bd231aed admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:38.076208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb655f4-e7e9-4238-8fa5-e518bd231aed admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:38.076773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb655f4-e7e9-4238-8fa5-e518bd231aed admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:38.077679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb655f4-e7e9-4238-8fa5-e518bd231aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:38.080053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb655f4-e7e9-4238-8fa5-e518bd231aed admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:38.099818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 986/1940] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:38.106651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb655f4-e7e9-4238-8fa5-e518bd231aed admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:38.125807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb655f4-e7e9-4238-8fa5-e518bd231aed admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:38.132328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec243b-1e6c-4fdf-aac5-f19a7b4aa8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:38.133828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec243b-1e6c-4fdf-aac5-f19a7b4aa8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:38.134360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec243b-1e6c-4fdf-aac5-f19a7b4aa8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:38.135060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec243b-1e6c-4fdf-aac5-f19a7b4aa8a8 admin admin] PATH_INFO: `/v3/projects/987704be8114493e9b642da5c1c5f7d2/users/1275838227e441caa0cccd63ad37965b/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:38.163249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec243b-1e6c-4fdf-aac5-f19a7b4aa8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987704be8114493e9b642da5c1c5f7d2, user_id=1275838227e441caa0cccd63ad37965b, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:38.168146 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec243b-1e6c-4fdf-aac5-f19a7b4aa8a8 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:38.169699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:38.184502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd73ef0ae3644b22869a52da54d1f64b'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.206644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 987/1941] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:38 2022] PUT /identity/v3/projects/987704be8114493e9b642da5c1c5f7d2/users/1275838227e441caa0cccd63ad37965b/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:38.211381 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3411d-f3a4-4f65-b947-b0457f728b40 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:38.211381 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3411d-f3a4-4f65-b947-b0457f728b40 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:38.211807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3411d-f3a4-4f65-b947-b0457f728b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:38.227508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd73ef0ae3644b22869a52da54d1f64b'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.228890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd73ef0ae3644b22869a52da54d1f64b'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.248461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd73ef0ae3644b22869a52da54d1f64b'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.267292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ea238283-c15f-4304-ae3a-52082bd9e518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd73ef0ae3644b22869a52da54d1f64b'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.289854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e9b3411d-f3a4-4f65-b947-b0457f728b40 None None] MFA Rules not processed for user `1275838227e441caa0cccd63ad37965b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:38.292334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e9b3411d-f3a4-4f65-b947-b0457f728b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:38.318450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 955/1942] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:38 2022] DELETE /identity/v3/users/dd73ef0ae3644b22869a52da54d1f64b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:38.320797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e40a-8504-42df-88ca-422cd947ed8d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:38.321246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e40a-8504-42df-88ca-422cd947ed8d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:38.321519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e40a-8504-42df-88ca-422cd947ed8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:38.341119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-1b76e40a-8504-42df-88ca-422cd947ed8d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:38.342509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1b76e40a-8504-42df-88ca-422cd947ed8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:38.377279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:38.428386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 988/1943] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:38.453533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3411d-f3a4-4f65-b947-b0457f728b40 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:38.455976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e9b3411d-f3a4-4f65-b947-b0457f728b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:38.492931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 956/1944] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:38.518188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e40a-8504-42df-88ca-422cd947ed8d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:38.521524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1b76e40a-8504-42df-88ca-422cd947ed8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:38.592279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3411d-f3a4-4f65-b947-b0457f728b40 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:38.610002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e40a-8504-42df-88ca-422cd947ed8d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:38.615372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f480e1-3a8b-4f12-bed8-bb54206d8273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:38.618141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f480e1-3a8b-4f12-bed8-bb54206d8273 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:38.618593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f480e1-3a8b-4f12-bed8-bb54206d8273 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:38.619033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f480e1-3a8b-4f12-bed8-bb54206d8273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:38.631619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f480e1-3a8b-4f12-bed8-bb54206d8273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:38.635122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f480e1-3a8b-4f12-bed8-bb54206d8273 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:38.649759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 957/1945] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:38.692051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f480e1-3a8b-4f12-bed8-bb54206d8273 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:38.694400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c6f480e1-3a8b-4f12-bed8-bb54206d8273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:38.718543 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732390f-39e3-478e-b02a-44d27ce70aa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:38.720897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732390f-39e3-478e-b02a-44d27ce70aa1 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:38.721242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732390f-39e3-478e-b02a-44d27ce70aa1 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:38.721528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732390f-39e3-478e-b02a-44d27ce70aa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:38.729420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f480e1-3a8b-4f12-bed8-bb54206d8273 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:38.739721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:38.741752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:38.742348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:38.743216 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] PATH_INFO: `/v3/projects/799d5e52506e4b6aa988eb440a0328e4` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:38.746435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=799d5e52506e4b6aa988eb440a0328e4)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:38.750512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:38.856621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799d5e52506e4b6aa988eb440a0328e4', 'request_id': 'req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.862623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732390f-39e3-478e-b02a-44d27ce70aa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:38.869000 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732390f-39e3-478e-b02a-44d27ce70aa1 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:38.874049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799d5e52506e4b6aa988eb440a0328e4', 'request_id': 'req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.878938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:38.886667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799d5e52506e4b6aa988eb440a0328e4', 'request_id': 'req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.888038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 989/1946] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:38.908932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] The token cache is being invalidate because project 799d5e52506e4b6aa988eb440a0328e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:38.909379 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.910211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:38.915816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 958/1947] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:38 2022] DELETE /identity/v3/projects/799d5e52506e4b6aa988eb440a0328e4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:38.923559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732390f-39e3-478e-b02a-44d27ce70aa1 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:38.937308 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732390f-39e3-478e-b02a-44d27ce70aa1 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:38.962058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:39.066695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:39.067815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:39.068229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:39.068638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] PATH_INFO: `/v3/users/453f53ca36584dbb8299c034c29d390b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:39.070562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453f53ca36584dbb8299c034c29d390b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:39.073788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:39.145296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:39.149531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:39.172504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453f53ca36584dbb8299c034c29d390b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.185117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e540a-e22d-431a-85eb-af0e1aa3de3e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:39.196887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:39.198732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:39.199316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:39.199937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] PATH_INFO: `/v3/projects/c4ee7ec0247d45b3b151115c4ca9febc` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:39.200724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453f53ca36584dbb8299c034c29d390b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.201987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453f53ca36584dbb8299c034c29d390b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.203137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ee7ec0247d45b3b151115c4ca9febc)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:39.208140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:39.216266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453f53ca36584dbb8299c034c29d390b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.233558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453f53ca36584dbb8299c034c29d390b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.248552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 990/1948] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:38 2022] DELETE /identity/v3/users/453f53ca36584dbb8299c034c29d390b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:39.328486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ee7ec0247d45b3b151115c4ca9febc', 'request_id': 'req-6a38302b-66b0-43a9-a795-da3649807d20'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.348078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ee7ec0247d45b3b151115c4ca9febc', 'request_id': 'req-6a38302b-66b0-43a9-a795-da3649807d20'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.364692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ee7ec0247d45b3b151115c4ca9febc', 'request_id': 'req-6a38302b-66b0-43a9-a795-da3649807d20'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.389450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] The token cache is being invalidate because project c4ee7ec0247d45b3b151115c4ca9febc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:39.390025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.391327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.400157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 959/1949] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:39 2022] DELETE /identity/v3/projects/c4ee7ec0247d45b3b151115c4ca9febc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:39.402628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:39.405265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:39.632296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cd2e5-67e1-47b3-a951-de890d957857 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:39.763893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:39.810999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:39.812420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:39.812915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:39.813501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] PATH_INFO: `/v3/users/6db6aed3e6214ea19b1c5b6759a76c65` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:39.816824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db6aed3e6214ea19b1c5b6759a76c65)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:39.819744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:39.910269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db6aed3e6214ea19b1c5b6759a76c65'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.934338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db6aed3e6214ea19b1c5b6759a76c65'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.935596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db6aed3e6214ea19b1c5b6759a76c65'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.947192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db6aed3e6214ea19b1c5b6759a76c65'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.959555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cce1621b-a65d-4af6-be1f-0bc289246fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db6aed3e6214ea19b1c5b6759a76c65'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:39.972270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 991/1950] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:39 2022] DELETE /identity/v3/users/6db6aed3e6214ea19b1c5b6759a76c65 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:40.064629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.066637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:40.087330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38302b-66b0-43a9-a795-da3649807d20 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.167163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:40.167966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.168253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.168532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] PATH_INFO: `/v3/projects/47946993fca14cdeb2ab8a9f2d7da17e` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.169886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47946993fca14cdeb2ab8a9f2d7da17e)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:40.172171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:40.228645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47946993fca14cdeb2ab8a9f2d7da17e', 'request_id': 'req-5198fd12-8fa2-4027-a1a6-b300c5ab355a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.237727 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47946993fca14cdeb2ab8a9f2d7da17e', 'request_id': 'req-5198fd12-8fa2-4027-a1a6-b300c5ab355a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.245932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47946993fca14cdeb2ab8a9f2d7da17e', 'request_id': 'req-5198fd12-8fa2-4027-a1a6-b300c5ab355a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.253616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:40.268933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] The token cache is being invalidate because project 47946993fca14cdeb2ab8a9f2d7da17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:40.269227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.269950 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.271699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 960/1951] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:40 2022] DELETE /identity/v3/projects/47946993fca14cdeb2ab8a9f2d7da17e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:40.277305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b7fb2-18c6-4ae1-a22e-8694ce9c0e2d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.277597 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b7fb2-18c6-4ae1-a22e-8694ce9c0e2d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.277879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b7fb2-18c6-4ae1-a22e-8694ce9c0e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.292210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.294224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:40.306283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-864b7fb2-18c6-4ae1-a22e-8694ce9c0e2d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:40.307795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-864b7fb2-18c6-4ae1-a22e-8694ce9c0e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:40.381394 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198fd12-8fa2-4027-a1a6-b300c5ab355a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.386210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:40.386473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 992/1952] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:40.387130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.387414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.387696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] PATH_INFO: `/v3/projects/23a6731884e347dfbd8d73898721a120` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.388990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a6731884e347dfbd8d73898721a120)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:40.390972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:40.400732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f5300-8f70-48a8-8b45-6da47c2ce04c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.401028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f5300-8f70-48a8-8b45-6da47c2ce04c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.401308 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f5300-8f70-48a8-8b45-6da47c2ce04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.420354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d58f5300-8f70-48a8-8b45-6da47c2ce04c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:40.421752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d58f5300-8f70-48a8-8b45-6da47c2ce04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:40.432468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 993/1953] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:40.436946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f5300-8f70-48a8-8b45-6da47c2ce04c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.446054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a6731884e347dfbd8d73898721a120', 'request_id': 'req-13e1b0da-5145-4cc5-bad2-29d2a7400414'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.446584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f5300-8f70-48a8-8b45-6da47c2ce04c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.455419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a6731884e347dfbd8d73898721a120', 'request_id': 'req-13e1b0da-5145-4cc5-bad2-29d2a7400414'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.462891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a6731884e347dfbd8d73898721a120', 'request_id': 'req-13e1b0da-5145-4cc5-bad2-29d2a7400414'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.482848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] The token cache is being invalidate because project 23a6731884e347dfbd8d73898721a120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:40.483200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.483875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-13e1b0da-5145-4cc5-bad2-29d2a7400414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:40.486048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 961/1954] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:40 2022] DELETE /identity/v3/projects/23a6731884e347dfbd8d73898721a120 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:40.491614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8af2d4-0305-44e9-9d1d-20bf14fd12f0 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.491953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8af2d4-0305-44e9-9d1d-20bf14fd12f0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.492286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8af2d4-0305-44e9-9d1d-20bf14fd12f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.515933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:40.526723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ad8af2d4-0305-44e9-9d1d-20bf14fd12f0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:40.527717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ad8af2d4-0305-44e9-9d1d-20bf14fd12f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:40.541127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:40.541860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.542148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.542495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.543800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:40.544507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:40.547833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:40.574644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 994/1955] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:51:40.579844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.581696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:40.595796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c424-7a62-4c9c-9a34-e91334da016e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.603228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58453041-c71d-4775-9feb-307a45a5e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:40.604728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58453041-c71d-4775-9feb-307a45a5e548 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.605094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58453041-c71d-4775-9feb-307a45a5e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.605848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58453041-c71d-4775-9feb-307a45a5e548 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.606741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58453041-c71d-4775-9feb-307a45a5e548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:40.609838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58453041-c71d-4775-9feb-307a45a5e548 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:40.625328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 962/1956] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:40.637940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0a765-487c-44a1-be18-e3e81ad021e0 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.638221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0a765-487c-44a1-be18-e3e81ad021e0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.638620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0a765-487c-44a1-be18-e3e81ad021e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.643755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 995/1957] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:40 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:40.648519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58453041-c71d-4775-9feb-307a45a5e548 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.660613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-dbc0a765-487c-44a1-be18-e3e81ad021e0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:40.662103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dbc0a765-487c-44a1-be18-e3e81ad021e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:40.698654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:40.744020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58453041-c71d-4775-9feb-307a45a5e548 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.748382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 963/1958] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:40.749469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de62e-3cc2-457e-94c8-6928de2ae0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:40.750264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de62e-3cc2-457e-94c8-6928de2ae0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.750680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de62e-3cc2-457e-94c8-6928de2ae0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.751078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de62e-3cc2-457e-94c8-6928de2ae0b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.751866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de62e-3cc2-457e-94c8-6928de2ae0b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:40.752929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0a765-487c-44a1-be18-e3e81ad021e0 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.756423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de62e-3cc2-457e-94c8-6928de2ae0b3 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:40.765029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0a765-487c-44a1-be18-e3e81ad021e0 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.773480 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e31c8-a07e-44a8-9228-992410b4d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:40.774729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e31c8-a07e-44a8-9228-992410b4d81a admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.775017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e31c8-a07e-44a8-9228-992410b4d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.775450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e31c8-a07e-44a8-9228-992410b4d81a admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.776334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e31c8-a07e-44a8-9228-992410b4d81a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:40.776645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e31c8-a07e-44a8-9228-992410b4d81a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:40.778515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e31c8-a07e-44a8-9228-992410b4d81a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:40.786221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 996/1959] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:40 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:40.791747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de62e-3cc2-457e-94c8-6928de2ae0b3 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.803061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 964/1960] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:40.805042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de62e-3cc2-457e-94c8-6928de2ae0b3 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.807709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e31c8-a07e-44a8-9228-992410b4d81a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.811741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddb1cc-35df-40ea-a306-ec9f001e1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:40.812675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddb1cc-35df-40ea-a306-ec9f001e1ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.813037 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddb1cc-35df-40ea-a306-ec9f001e1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.813417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddb1cc-35df-40ea-a306-ec9f001e1ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.814264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddb1cc-35df-40ea-a306-ec9f001e1ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:40.816432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddb1cc-35df-40ea-a306-ec9f001e1ee6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:40.821690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e31c8-a07e-44a8-9228-992410b4d81a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.828356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 997/1961] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:40.830607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83647414-80dd-46cb-a39d-b291a340fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:40.831555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83647414-80dd-46cb-a39d-b291a340fd4f admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.831805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83647414-80dd-46cb-a39d-b291a340fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.832233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83647414-80dd-46cb-a39d-b291a340fd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.832864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddb1cc-35df-40ea-a306-ec9f001e1ee6 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.833112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83647414-80dd-46cb-a39d-b291a340fd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:40.835235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83647414-80dd-46cb-a39d-b291a340fd4f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:40.846431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddb1cc-35df-40ea-a306-ec9f001e1ee6 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.855620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9b2dc-7643-42d6-bfa3-59a7547816b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:40.856311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9b2dc-7643-42d6-bfa3-59a7547816b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:40.856810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9b2dc-7643-42d6-bfa3-59a7547816b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:40.857096 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9b2dc-7643-42d6-bfa3-59a7547816b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:40.858223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9b2dc-7643-42d6-bfa3-59a7547816b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:40.859888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9b2dc-7643-42d6-bfa3-59a7547816b7 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:40.876039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 998/1962] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:40.884590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9b2dc-7643-42d6-bfa3-59a7547816b7 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:40.902673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 965/1963] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:40 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:40.906816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9b2dc-7643-42d6-bfa3-59a7547816b7 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:40.908724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83647414-80dd-46cb-a39d-b291a340fd4f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.060955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b922e4-0b2b-4d23-89bd-93c4563766d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.062785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b922e4-0b2b-4d23-89bd-93c4563766d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.063318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b922e4-0b2b-4d23-89bd-93c4563766d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.063977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b922e4-0b2b-4d23-89bd-93c4563766d7 admin admin] PATH_INFO: `/v3/projects/770037aa51f44db582ec63200a1be995/users/d33b1203eb7f4513877729e90498947e/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.087254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83647414-80dd-46cb-a39d-b291a340fd4f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.092669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c41fe-be88-428b-baa3-cb757cfebc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.093974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c41fe-be88-428b-baa3-cb757cfebc7c admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.094982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c41fe-be88-428b-baa3-cb757cfebc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.095342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c41fe-be88-428b-baa3-cb757cfebc7c admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.096128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c41fe-be88-428b-baa3-cb757cfebc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.098441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c41fe-be88-428b-baa3-cb757cfebc7c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.115763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b922e4-0b2b-4d23-89bd-93c4563766d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770037aa51f44db582ec63200a1be995, user_id=d33b1203eb7f4513877729e90498947e, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.120838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b922e4-0b2b-4d23-89bd-93c4563766d7 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.145467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 999/1964] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:40 2022] PUT /identity/v3/projects/770037aa51f44db582ec63200a1be995/users/d33b1203eb7f4513877729e90498947e/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:41.145880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 966/1965] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:40 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:41.146860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b922e4-0b2b-4d23-89bd-93c4563766d7 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.156788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909677-7146-4175-a862-ddae4bd1bd1a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.157199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909677-7146-4175-a862-ddae4bd1bd1a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.157862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909677-7146-4175-a862-ddae4bd1bd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.197838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:41.220952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-df909677-7146-4175-a862-ddae4bd1bd1a None None] MFA Rules not processed for user `d33b1203eb7f4513877729e90498947e`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:41.229010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-df909677-7146-4175-a862-ddae4bd1bd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:41.279253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b922e4-0b2b-4d23-89bd-93c4563766d7 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.290076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcf295-fd5a-424e-8259-dc37f27ec46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.291255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcf295-fd5a-424e-8259-dc37f27ec46b admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.291695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcf295-fd5a-424e-8259-dc37f27ec46b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.292304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcf295-fd5a-424e-8259-dc37f27ec46b admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.293213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcf295-fd5a-424e-8259-dc37f27ec46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.296097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbcf295-fd5a-424e-8259-dc37f27ec46b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.318452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1000/1966] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:41.323496 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcf295-fd5a-424e-8259-dc37f27ec46b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.334859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 967/1967] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:41.337959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcf295-fd5a-424e-8259-dc37f27ec46b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.342292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909677-7146-4175-a862-ddae4bd1bd1a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.345410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf23d-30ea-46f9-8606-c67b6823ba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.346336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf23d-30ea-46f9-8606-c67b6823ba3c admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.346847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf23d-30ea-46f9-8606-c67b6823ba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.347313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf23d-30ea-46f9-8606-c67b6823ba3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.348550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cf23d-30ea-46f9-8606-c67b6823ba3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.350897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cf23d-30ea-46f9-8606-c67b6823ba3c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.354459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909677-7146-4175-a862-ddae4bd1bd1a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.359713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64228b02-5877-448e-a516-cabeb9894ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.360432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64228b02-5877-448e-a516-cabeb9894ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.360730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64228b02-5877-448e-a516-cabeb9894ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.361012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64228b02-5877-448e-a516-cabeb9894ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.361733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64228b02-5877-448e-a516-cabeb9894ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.363700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64228b02-5877-448e-a516-cabeb9894ca1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.364410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1001/1968] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:41.368823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf23d-30ea-46f9-8606-c67b6823ba3c admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.378059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:41.379364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf23d-30ea-46f9-8606-c67b6823ba3c admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.385464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fcae3-8e34-4eb6-9ead-496c14fe4b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.386491 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fcae3-8e34-4eb6-9ead-496c14fe4b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.386709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fcae3-8e34-4eb6-9ead-496c14fe4b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.386982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fcae3-8e34-4eb6-9ead-496c14fe4b37 admin admin] PATH_INFO: `/v3/projects/e23f81c0243e462185c489198714929b/users/290c1568420941119c48acb7a4b44de3/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.393067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 968/1969] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:41 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:41.397160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64228b02-5877-448e-a516-cabeb9894ca1 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.405089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fcae3-8e34-4eb6-9ead-496c14fe4b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23f81c0243e462185c489198714929b, user_id=290c1568420941119c48acb7a4b44de3, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.408165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fcae3-8e34-4eb6-9ead-496c14fe4b37 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.424240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1002/1970] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:41 2022] PUT /identity/v3/projects/e23f81c0243e462185c489198714929b/users/290c1568420941119c48acb7a4b44de3/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:41.436191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54ab41-198f-4bcc-89cf-e2c7de33cd65 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.436507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54ab41-198f-4bcc-89cf-e2c7de33cd65 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.436795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54ab41-198f-4bcc-89cf-e2c7de33cd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.466548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64228b02-5877-448e-a516-cabeb9894ca1 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.479184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-0a54ab41-198f-4bcc-89cf-e2c7de33cd65 None None] MFA Rules not processed for user `290c1568420941119c48acb7a4b44de3`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:41.480912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0a54ab41-198f-4bcc-89cf-e2c7de33cd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:41.560250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da96ae-10c9-4502-8816-a707e680ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.561139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da96ae-10c9-4502-8816-a707e680ced5 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.561503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da96ae-10c9-4502-8816-a707e680ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.561789 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da96ae-10c9-4502-8816-a707e680ced5 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.562786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da96ae-10c9-4502-8816-a707e680ced5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.564620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da96ae-10c9-4502-8816-a707e680ced5 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.583028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1003/1971] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:41.593132 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 969/1972] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:41 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:41.594764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54ab41-198f-4bcc-89cf-e2c7de33cd65 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.595393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da96ae-10c9-4502-8816-a707e680ced5 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.597489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-35da96ae-10c9-4502-8816-a707e680ced5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:41.608513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54ab41-198f-4bcc-89cf-e2c7de33cd65 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.613564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be151428-061e-4642-9858-33f7d1f2a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.614249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be151428-061e-4642-9858-33f7d1f2a365 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.614578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be151428-061e-4642-9858-33f7d1f2a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.615021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be151428-061e-4642-9858-33f7d1f2a365 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.615767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be151428-061e-4642-9858-33f7d1f2a365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.618197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be151428-061e-4642-9858-33f7d1f2a365 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.633884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1004/1973] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:41.635697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be151428-061e-4642-9858-33f7d1f2a365 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.646948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be151428-061e-4642-9858-33f7d1f2a365 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.652487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55e597-6c3a-4de6-84eb-dd96fb161c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.653456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55e597-6c3a-4de6-84eb-dd96fb161c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.653740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55e597-6c3a-4de6-84eb-dd96fb161c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.654681 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55e597-6c3a-4de6-84eb-dd96fb161c64 admin admin] PATH_INFO: `/v3/projects/302996e4c2e94110966c8a31437bf51b/users/86d3ec7dc1e94e11a790284dabf54cc2/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.665085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da96ae-10c9-4502-8816-a707e680ced5 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.669433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b3322-a284-46d9-91fc-9783c79c9c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.670103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b3322-a284-46d9-91fc-9783c79c9c0e service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.670507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b3322-a284-46d9-91fc-9783c79c9c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.670698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b3322-a284-46d9-91fc-9783c79c9c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.672012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55e597-6c3a-4de6-84eb-dd96fb161c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302996e4c2e94110966c8a31437bf51b, user_id=86d3ec7dc1e94e11a790284dabf54cc2, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.674806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55e597-6c3a-4de6-84eb-dd96fb161c64 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.681539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b3322-a284-46d9-91fc-9783c79c9c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.685710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b3322-a284-46d9-91fc-9783c79c9c0e service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.699330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1005/1974] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:41 2022] PUT /identity/v3/projects/302996e4c2e94110966c8a31437bf51b/users/86d3ec7dc1e94e11a790284dabf54cc2/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:41.702228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 970/1975] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:41.706207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55e597-6c3a-4de6-84eb-dd96fb161c64 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.726013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b3322-a284-46d9-91fc-9783c79c9c0e service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.738755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b3322-a284-46d9-91fc-9783c79c9c0e service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.749842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:41.773860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:41.786965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55e597-6c3a-4de6-84eb-dd96fb161c64 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.791920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694bd19-da5c-4230-841e-ba4e32679e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.792600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694bd19-da5c-4230-841e-ba4e32679e1b admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.792882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694bd19-da5c-4230-841e-ba4e32679e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.793159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694bd19-da5c-4230-841e-ba4e32679e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.793911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694bd19-da5c-4230-841e-ba4e32679e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.795550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694bd19-da5c-4230-841e-ba4e32679e1b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.805808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.806729 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.807019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.807300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] PATH_INFO: `/v3/users/290c1568420941119c48acb7a4b44de3` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.810454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1006/1976] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:41.810680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=290c1568420941119c48acb7a4b44de3)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.810680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.812127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694bd19-da5c-4230-841e-ba4e32679e1b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.823343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694bd19-da5c-4230-841e-ba4e32679e1b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:41.828234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38587bd-a84f-4fa5-817f-e8aead641d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:41.829127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38587bd-a84f-4fa5-817f-e8aead641d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.829417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38587bd-a84f-4fa5-817f-e8aead641d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.829692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38587bd-a84f-4fa5-817f-e8aead641d5a admin admin] PATH_INFO: `/v3/projects/302996e4c2e94110966c8a31437bf51b/users/86d3ec7dc1e94e11a790284dabf54cc2/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.831699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38587bd-a84f-4fa5-817f-e8aead641d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=302996e4c2e94110966c8a31437bf51b, user_id=86d3ec7dc1e94e11a790284dabf54cc2, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:41.834325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38587bd-a84f-4fa5-817f-e8aead641d5a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:41.846109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1007/1977] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:41 2022] PUT /identity/v3/projects/302996e4c2e94110966c8a31437bf51b/users/86d3ec7dc1e94e11a790284dabf54cc2/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:41.858115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b8644-aba0-489f-8bc9-21c3fed71075 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.858312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b8644-aba0-489f-8bc9-21c3fed71075 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.858625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b8644-aba0-489f-8bc9-21c3fed71075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.864556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290c1568420941119c48acb7a4b44de3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:41.877211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290c1568420941119c48acb7a4b44de3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:41.877928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290c1568420941119c48acb7a4b44de3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:41.884785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290c1568420941119c48acb7a4b44de3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:41.886722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-459b8644-aba0-489f-8bc9-21c3fed71075 None None] MFA Rules not processed for user `86d3ec7dc1e94e11a790284dabf54cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:41.887964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-459b8644-aba0-489f-8bc9-21c3fed71075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:41.892594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b5ea2221-7a54-4d2c-a56f-998bb9562b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290c1568420941119c48acb7a4b44de3'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:41.899948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 971/1978] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:41 2022] DELETE /identity/v3/users/290c1568420941119c48acb7a4b44de3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:41.904358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfdd4-0777-4a47-a944-ec079db61907 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:41.904645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfdd4-0777-4a47-a944-ec079db61907 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:41.904949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfdd4-0777-4a47-a944-ec079db61907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:41.923145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-117bfdd4-0777-4a47-a944-ec079db61907 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:41.924348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-117bfdd4-0777-4a47-a944-ec079db61907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:41.962158 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1008/1979] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:41.975303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b8644-aba0-489f-8bc9-21c3fed71075 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:41.977458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-459b8644-aba0-489f-8bc9-21c3fed71075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:41.994258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 972/1980] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:42.004117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bfdd4-0777-4a47-a944-ec079db61907 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:42.005663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-117bfdd4-0777-4a47-a944-ec079db61907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:42.043298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b8644-aba0-489f-8bc9-21c3fed71075 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:42.078494 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bfdd4-0777-4a47-a944-ec079db61907 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:42.082173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996eba1-6af1-4454-b8cc-dbd48813895a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:42.082853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996eba1-6af1-4454-b8cc-dbd48813895a service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.083134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996eba1-6af1-4454-b8cc-dbd48813895a service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.083506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996eba1-6af1-4454-b8cc-dbd48813895a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.093876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:42.096573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996eba1-6af1-4454-b8cc-dbd48813895a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:42.097609 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51b49d-84c5-4294-b9c1-ab382e44850f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:42.098280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51b49d-84c5-4294-b9c1-ab382e44850f service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.098427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996eba1-6af1-4454-b8cc-dbd48813895a service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:42.098614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51b49d-84c5-4294-b9c1-ab382e44850f service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.098896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51b49d-84c5-4294-b9c1-ab382e44850f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.111213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 973/1981] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:42.114593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:42.195501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51b49d-84c5-4294-b9c1-ab382e44850f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:42.197286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51b49d-84c5-4294-b9c1-ab382e44850f service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:42.213430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1009/1982] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:42.255363 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996eba1-6af1-4454-b8cc-dbd48813895a service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:42.257082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1996eba1-6af1-4454-b8cc-dbd48813895a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:42.272926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996eba1-6af1-4454-b8cc-dbd48813895a service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:42.278556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:42.279461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.279740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.280014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] PATH_INFO: `/v3/users/d33b1203eb7f4513877729e90498947e` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.281539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33b1203eb7f4513877729e90498947e)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:42.283589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:42.370077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33b1203eb7f4513877729e90498947e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.392204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51b49d-84c5-4294-b9c1-ab382e44850f service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:42.393702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8b51b49d-84c5-4294-b9c1-ab382e44850f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:42.393833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33b1203eb7f4513877729e90498947e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.394573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33b1203eb7f4513877729e90498947e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.407559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33b1203eb7f4513877729e90498947e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.415421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51b49d-84c5-4294-b9c1-ab382e44850f service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:42.418698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6343ce76-f2f3-43e5-bdd3-9adcd584ac98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33b1203eb7f4513877729e90498947e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.421949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:42.422514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.423145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.423284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] PATH_INFO: `/v3/users/1275838227e441caa0cccd63ad37965b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.425152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1275838227e441caa0cccd63ad37965b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:42.427282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:42.438732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 974/1983] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:42 2022] DELETE /identity/v3/users/d33b1203eb7f4513877729e90498947e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:42.445319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca52c-dca7-4c08-8eb8-b21fec3abcb1 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.445319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca52c-dca7-4c08-8eb8-b21fec3abcb1 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.445319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca52c-dca7-4c08-8eb8-b21fec3abcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.471113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-924ca52c-dca7-4c08-8eb8-b21fec3abcb1 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:42.473000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-924ca52c-dca7-4c08-8eb8-b21fec3abcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:42.518802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1275838227e441caa0cccd63ad37965b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.536924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1275838227e441caa0cccd63ad37965b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.537698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1275838227e441caa0cccd63ad37965b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.548006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1275838227e441caa0cccd63ad37965b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.564310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-326c7960-1dde-47b9-b13b-5a2b1d7f01ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1275838227e441caa0cccd63ad37965b'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.576167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1010/1984] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:42 2022] DELETE /identity/v3/users/1275838227e441caa0cccd63ad37965b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:42.584906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0c633-9712-4533-ad5f-718a51f7cc34 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.585219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0c633-9712-4533-ad5f-718a51f7cc34 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.585599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0c633-9712-4533-ad5f-718a51f7cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.619183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-24d0c633-9712-4533-ad5f-718a51f7cc34 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:42.621859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-24d0c633-9712-4533-ad5f-718a51f7cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:42.626578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 975/1985] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:42.641170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca52c-dca7-4c08-8eb8-b21fec3abcb1 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:42.643303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-924ca52c-dca7-4c08-8eb8-b21fec3abcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:42.748072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca52c-dca7-4c08-8eb8-b21fec3abcb1 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:42.756158 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1011/1986] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:42.757378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0c633-9712-4533-ad5f-718a51f7cc34 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:42.759198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-24d0c633-9712-4533-ad5f-718a51f7cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:42.775035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0c633-9712-4533-ad5f-718a51f7cc34 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:42.778476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:42.780800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:42.781809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.782163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.782582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] PATH_INFO: `/v3/projects/e23f81c0243e462185c489198714929b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.784540 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23f81c0243e462185c489198714929b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:42.786594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:42.821651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:42.828286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f424a72-0d36-42cd-8c8d-be94790428b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:42.829322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f424a72-0d36-42cd-8c8d-be94790428b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.829605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f424a72-0d36-42cd-8c8d-be94790428b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.829934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f424a72-0d36-42cd-8c8d-be94790428b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.848932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f424a72-0d36-42cd-8c8d-be94790428b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:42.852151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f424a72-0d36-42cd-8c8d-be94790428b4 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:42.874631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23f81c0243e462185c489198714929b', 'request_id': 'req-da510e36-2886-4a36-a8e5-d550c525a686'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.878674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 976/1987] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:42.879910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f424a72-0d36-42cd-8c8d-be94790428b4 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:42.882308 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23f81c0243e462185c489198714929b', 'request_id': 'req-da510e36-2886-4a36-a8e5-d550c525a686'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.891821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f424a72-0d36-42cd-8c8d-be94790428b4 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:42.892427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23f81c0243e462185c489198714929b', 'request_id': 'req-da510e36-2886-4a36-a8e5-d550c525a686'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.913798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] The token cache is being invalidate because project e23f81c0243e462185c489198714929b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:42.914135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.914872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-da510e36-2886-4a36-a8e5-d550c525a686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:42.916506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1012/1988] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:42 2022] DELETE /identity/v3/projects/e23f81c0243e462185c489198714929b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:42.922235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882100f-4077-4ae1-8c99-b4c17f48f251 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.922689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882100f-4077-4ae1-8c99-b4c17f48f251 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.922859 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882100f-4077-4ae1-8c99-b4c17f48f251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.943961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-9882100f-4077-4ae1-8c99-b4c17f48f251 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:42.945371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9882100f-4077-4ae1-8c99-b4c17f48f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:42.966701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4163a51-965c-4351-915a-bca3078e0f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:42.966701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4163a51-965c-4351-915a-bca3078e0f39 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:42.967154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4163a51-965c-4351-915a-bca3078e0f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:42.967416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4163a51-965c-4351-915a-bca3078e0f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:42.970429 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a4163a51-965c-4351-915a-bca3078e0f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:43.056399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1013/1989] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:43.068960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86a993-5aeb-4ec6-b06b-e36eb9615124 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.068960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86a993-5aeb-4ec6-b06b-e36eb9615124 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.068960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86a993-5aeb-4ec6-b06b-e36eb9615124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.087068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4163a51-965c-4351-915a-bca3078e0f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.090585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4163a51-965c-4351-915a-bca3078e0f39 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.094529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-7e86a993-5aeb-4ec6-b06b-e36eb9615124 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:43.095863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7e86a993-5aeb-4ec6-b06b-e36eb9615124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:43.104841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1014/1990] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:43.110208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86a993-5aeb-4ec6-b06b-e36eb9615124 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:43.110540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 977/1991] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:43.130761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86a993-5aeb-4ec6-b06b-e36eb9615124 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:43.138166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff15f7-bf4f-4f1f-89e6-31c626acea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:43.139276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff15f7-bf4f-4f1f-89e6-31c626acea41 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.139735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff15f7-bf4f-4f1f-89e6-31c626acea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.140025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff15f7-bf4f-4f1f-89e6-31c626acea41 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.140770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff15f7-bf4f-4f1f-89e6-31c626acea41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:43.141451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff15f7-bf4f-4f1f-89e6-31c626acea41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.143205 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff15f7-bf4f-4f1f-89e6-31c626acea41 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.167270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1015/1992] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:43.170437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4163a51-965c-4351-915a-bca3078e0f39 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:43.191788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4163a51-965c-4351-915a-bca3078e0f39 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:43.204112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd620b1-4c7f-4d39-82e0-bde504fa0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:43.205816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd620b1-4c7f-4d39-82e0-bde504fa0745 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.206298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd620b1-4c7f-4d39-82e0-bde504fa0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.206796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd620b1-4c7f-4d39-82e0-bde504fa0745 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.207934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd620b1-4c7f-4d39-82e0-bde504fa0745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.210159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd620b1-4c7f-4d39-82e0-bde504fa0745 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.260051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 978/1993] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:43 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:43.264273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff15f7-bf4f-4f1f-89e6-31c626acea41 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:43.280327 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff15f7-bf4f-4f1f-89e6-31c626acea41 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:43.382048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872ffa5-4b18-4416-8814-ea99cc293652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:43.382538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd620b1-4c7f-4d39-82e0-bde504fa0745 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:43.383141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872ffa5-4b18-4416-8814-ea99cc293652 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.383489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872ffa5-4b18-4416-8814-ea99cc293652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.383837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872ffa5-4b18-4416-8814-ea99cc293652 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.384541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872ffa5-4b18-4416-8814-ea99cc293652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.385173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-9fd620b1-4c7f-4d39-82e0-bde504fa0745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:43.390298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872ffa5-4b18-4416-8814-ea99cc293652 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.427262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1016/1994] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:43 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:43.428359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd620b1-4c7f-4d39-82e0-bde504fa0745 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:43.428832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872ffa5-4b18-4416-8814-ea99cc293652 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:43.435374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:43.436390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.436676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.436951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] PATH_INFO: `/v3/projects/770037aa51f44db582ec63200a1be995` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.439266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=770037aa51f44db582ec63200a1be995)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.440265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.445075 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872ffa5-4b18-4416-8814-ea99cc293652 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:43.460829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdc15e-140c-4d85-9299-1736b50e10bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:43.462042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdc15e-140c-4d85-9299-1736b50e10bc admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.462530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdc15e-140c-4d85-9299-1736b50e10bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.462956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdc15e-140c-4d85-9299-1736b50e10bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.463989 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdc15e-140c-4d85-9299-1736b50e10bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.465729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdc15e-140c-4d85-9299-1736b50e10bc admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.477813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1017/1995] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:43.481761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdc15e-140c-4d85-9299-1736b50e10bc admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:43.487272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:43.505336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdc15e-140c-4d85-9299-1736b50e10bc admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:43.512067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770037aa51f44db582ec63200a1be995', 'request_id': 'req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.513368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:43.535858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770037aa51f44db582ec63200a1be995', 'request_id': 'req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.549517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770037aa51f44db582ec63200a1be995', 'request_id': 'req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.571715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] The token cache is being invalidate because project 770037aa51f44db582ec63200a1be995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:43.572042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.572699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.575123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 979/1996] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:43 2022] DELETE /identity/v3/projects/770037aa51f44db582ec63200a1be995 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:43.578585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:43.580066 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:43.626473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304e087-6f91-428b-8894-268088a8dd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:43.627280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304e087-6f91-428b-8894-268088a8dd8e admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.627509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304e087-6f91-428b-8894-268088a8dd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.627964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304e087-6f91-428b-8894-268088a8dd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.630457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304e087-6f91-428b-8894-268088a8dd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.630720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304e087-6f91-428b-8894-268088a8dd8e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.644000 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1018/1997] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:43.644870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304e087-6f91-428b-8894-268088a8dd8e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:43.647915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1304e087-6f91-428b-8894-268088a8dd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:43.665366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304e087-6f91-428b-8894-268088a8dd8e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:43.670283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:43.671485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.671774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.672057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] PATH_INFO: `/v3/users/86d3ec7dc1e94e11a790284dabf54cc2` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.673301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d3ec7dc1e94e11a790284dabf54cc2)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.675281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.681800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5112a-e4be-4a99-9ba0-78458d40cfbc admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:43.704341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:43.705267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.705552 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.718675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] PATH_INFO: `/v3/projects/987704be8114493e9b642da5c1c5f7d2` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.720242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=987704be8114493e9b642da5c1c5f7d2)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.722466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.752430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d3ec7dc1e94e11a790284dabf54cc2'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.772432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d3ec7dc1e94e11a790284dabf54cc2'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.777218 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d3ec7dc1e94e11a790284dabf54cc2'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.787489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d3ec7dc1e94e11a790284dabf54cc2'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.797503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987704be8114493e9b642da5c1c5f7d2', 'request_id': 'req-83e772ef-ccd6-40c6-a965-8a81dfce1371'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.800999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d3ec7dc1e94e11a790284dabf54cc2'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.809982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987704be8114493e9b642da5c1c5f7d2', 'request_id': 'req-83e772ef-ccd6-40c6-a965-8a81dfce1371'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.810185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1019/1998] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:43 2022] DELETE /identity/v3/users/86d3ec7dc1e94e11a790284dabf54cc2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:43.814151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:43.815690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:43.819724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987704be8114493e9b642da5c1c5f7d2', 'request_id': 'req-83e772ef-ccd6-40c6-a965-8a81dfce1371'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.834703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] The token cache is being invalidate because project 987704be8114493e9b642da5c1c5f7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:43.835030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.835693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83e772ef-ccd6-40c6-a965-8a81dfce1371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:43.838879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 980/1999] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:43 2022] DELETE /identity/v3/projects/987704be8114493e9b642da5c1c5f7d2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:43.844108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bf013-2e1d-47d7-89bb-31b630483872 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.844530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bf013-2e1d-47d7-89bb-31b630483872 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.844859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bf013-2e1d-47d7-89bb-31b630483872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.873204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2d2bf013-2e1d-47d7-89bb-31b630483872 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:43.874758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2d2bf013-2e1d-47d7-89bb-31b630483872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:43.918958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65138c5-8483-4212-a201-0b2e884f5a91 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:43.930210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f76b2d-17bb-41c0-8869-bdf870996ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:43.931514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76b2d-17bb-41c0-8869-bdf870996ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:43.931900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76b2d-17bb-41c0-8869-bdf870996ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:43.934989 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76b2d-17bb-41c0-8869-bdf870996ca1 admin admin] PATH_INFO: `/v3/projects/6ad779b4ef144525aa3c0a72f4257c6a/users/7b5a3662fe61449bb87e146114bc6f0f/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:43.961808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f76b2d-17bb-41c0-8869-bdf870996ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad779b4ef144525aa3c0a72f4257c6a, user_id=7b5a3662fe61449bb87e146114bc6f0f, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:43.964579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f76b2d-17bb-41c0-8869-bdf870996ca1 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:43.967322 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:43.989059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1020/2000] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:43 2022] PUT /identity/v3/projects/6ad779b4ef144525aa3c0a72f4257c6a/users/7b5a3662fe61449bb87e146114bc6f0f/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:44.000780 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c443adb-831d-4c30-ac08-6a42cd7ec5b8 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.001177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c443adb-831d-4c30-ac08-6a42cd7ec5b8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.001536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c443adb-831d-4c30-ac08-6a42cd7ec5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.002717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 981/2001] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:44.011507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427185e-10ed-44c9-91ca-e747edbe0385 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.011900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427185e-10ed-44c9-91ca-e747edbe0385 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.012184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427185e-10ed-44c9-91ca-e747edbe0385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.035722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-0c443adb-831d-4c30-ac08-6a42cd7ec5b8 None None] MFA Rules not processed for user `7b5a3662fe61449bb87e146114bc6f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:44.036834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0c443adb-831d-4c30-ac08-6a42cd7ec5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:44.040309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c427185e-10ed-44c9-91ca-e747edbe0385 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:44.041764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c427185e-10ed-44c9-91ca-e747edbe0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:44.047710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:44.138184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 982/2002] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:44.142133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427185e-10ed-44c9-91ca-e747edbe0385 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.149634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1021/2003] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:44.156423 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427185e-10ed-44c9-91ca-e747edbe0385 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.160136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c443adb-831d-4c30-ac08-6a42cd7ec5b8 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.161591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0c443adb-831d-4c30-ac08-6a42cd7ec5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:44.163053 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec500aac-99c2-4582-8d14-82892d0b1866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.163242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec500aac-99c2-4582-8d14-82892d0b1866 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.163737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec500aac-99c2-4582-8d14-82892d0b1866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.165225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec500aac-99c2-4582-8d14-82892d0b1866 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.165981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec500aac-99c2-4582-8d14-82892d0b1866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:44.166436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec500aac-99c2-4582-8d14-82892d0b1866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.170046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec500aac-99c2-4582-8d14-82892d0b1866 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.185535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 983/2004] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:51:44.189655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec500aac-99c2-4582-8d14-82892d0b1866 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.204490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec500aac-99c2-4582-8d14-82892d0b1866 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.211133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292c639-a89f-4c6b-ad17-60123ec673d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.211813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292c639-a89f-4c6b-ad17-60123ec673d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.212101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292c639-a89f-4c6b-ad17-60123ec673d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.212518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292c639-a89f-4c6b-ad17-60123ec673d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.213103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292c639-a89f-4c6b-ad17-60123ec673d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.215374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292c639-a89f-4c6b-ad17-60123ec673d4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.251352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 984/2005] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:44 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:44.253274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292c639-a89f-4c6b-ad17-60123ec673d4 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.260865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5292c639-a89f-4c6b-ad17-60123ec673d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:44.295260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c443adb-831d-4c30-ac08-6a42cd7ec5b8 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.360930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629b89b-6890-4644-af62-cd339034beed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.361637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629b89b-6890-4644-af62-cd339034beed service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.361875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629b89b-6890-4644-af62-cd339034beed service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.362231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629b89b-6890-4644-af62-cd339034beed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.362455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292c639-a89f-4c6b-ad17-60123ec673d4 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.371275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.372891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.373375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.373766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] PATH_INFO: `/v3/projects/302996e4c2e94110966c8a31437bf51b` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.376270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=302996e4c2e94110966c8a31437bf51b)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.379938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.456591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302996e4c2e94110966c8a31437bf51b', 'request_id': 'req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:44.458901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:44.464249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629b89b-6890-4644-af62-cd339034beed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.465744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629b89b-6890-4644-af62-cd339034beed service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.467220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302996e4c2e94110966c8a31437bf51b', 'request_id': 'req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:44.474309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302996e4c2e94110966c8a31437bf51b', 'request_id': 'req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:44.476142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1022/2006] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:44.477642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629b89b-6890-4644-af62-cd339034beed service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.489357 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629b89b-6890-4644-af62-cd339034beed service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.490425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] The token cache is being invalidate because project 302996e4c2e94110966c8a31437bf51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:44.490875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:44.491883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f19f2bbf-78ff-46f5-8047-d4b96ca93e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:44.493995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 985/2007] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:44 2022] DELETE /identity/v3/projects/302996e4c2e94110966c8a31437bf51b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:44.499000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d441779-4494-470e-93fb-f37ee2067ed7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.499287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d441779-4494-470e-93fb-f37ee2067ed7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.499593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d441779-4494-470e-93fb-f37ee2067ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.512312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:44.529538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7d441779-4494-470e-93fb-f37ee2067ed7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:44.531711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7d441779-4494-470e-93fb-f37ee2067ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:44.579085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654d796-1b92-40c7-abc2-1486d0cbb67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.579770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654d796-1b92-40c7-abc2-1486d0cbb67f admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.580052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654d796-1b92-40c7-abc2-1486d0cbb67f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.580382 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654d796-1b92-40c7-abc2-1486d0cbb67f admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.581707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654d796-1b92-40c7-abc2-1486d0cbb67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.583871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654d796-1b92-40c7-abc2-1486d0cbb67f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.610412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1023/2008] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:44 2022] POST /identity/v3/users => generated 282 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:44.612604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654d796-1b92-40c7-abc2-1486d0cbb67f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.616293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b654d796-1b92-40c7-abc2-1486d0cbb67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:44.626479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 986/2009] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:44.635992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654d796-1b92-40c7-abc2-1486d0cbb67f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.636167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e127a-b337-471e-964f-7d01109ba194 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.636346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e127a-b337-471e-964f-7d01109ba194 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.636623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e127a-b337-471e-964f-7d01109ba194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.644162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6b1b-a46d-4bf9-a860-a56e6e050742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.644863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6b1b-a46d-4bf9-a860-a56e6e050742 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.645217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6b1b-a46d-4bf9-a860-a56e6e050742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.645547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d6b1b-a46d-4bf9-a860-a56e6e050742 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.646357 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6b1b-a46d-4bf9-a860-a56e6e050742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.648066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d6b1b-a46d-4bf9-a860-a56e6e050742 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.659106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-678e127a-b337-471e-964f-7d01109ba194 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:44.660346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-678e127a-b337-471e-964f-7d01109ba194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:44.670025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 987/2010] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:44.675076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1024/2011] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:44.676803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6b1b-a46d-4bf9-a860-a56e6e050742 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.677791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e127a-b337-471e-964f-7d01109ba194 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.687947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d6b1b-a46d-4bf9-a860-a56e6e050742 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.692789 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e127a-b337-471e-964f-7d01109ba194 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.693588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed7bd6-3c27-4e74-a49c-5506b8df99ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.694330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed7bd6-3c27-4e74-a49c-5506b8df99ac admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.694649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed7bd6-3c27-4e74-a49c-5506b8df99ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.694937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed7bd6-3c27-4e74-a49c-5506b8df99ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.695704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed7bd6-3c27-4e74-a49c-5506b8df99ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.697328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed7bd6-3c27-4e74-a49c-5506b8df99ac admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.704899 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f73f7-adc9-4cb7-9c4f-9e7b3840aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.705891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f73f7-adc9-4cb7-9c4f-9e7b3840aea3 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.706197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f73f7-adc9-4cb7-9c4f-9e7b3840aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.706514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f73f7-adc9-4cb7-9c4f-9e7b3840aea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.707275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f73f7-adc9-4cb7-9c4f-9e7b3840aea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:44.707572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f73f7-adc9-4cb7-9c4f-9e7b3840aea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.709301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f73f7-adc9-4cb7-9c4f-9e7b3840aea3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.713720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1025/2012] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:44.717849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed7bd6-3c27-4e74-a49c-5506b8df99ac admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.729285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 988/2013] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:51:44.730917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f73f7-adc9-4cb7-9c4f-9e7b3840aea3 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.734769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed7bd6-3c27-4e74-a49c-5506b8df99ac admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.742118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f73f7-adc9-4cb7-9c4f-9e7b3840aea3 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.742966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346937dc-15e1-4eed-b39b-d3ee6110cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.743621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346937dc-15e1-4eed-b39b-d3ee6110cf71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.743951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346937dc-15e1-4eed-b39b-d3ee6110cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.744220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346937dc-15e1-4eed-b39b-d3ee6110cf71 admin admin] PATH_INFO: `/v3/projects/258f3af07bf944e68d72d5d173e9e4b7/users/48e81f8fffcf4e6f8b0576ff5359a5f2/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.748561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06314193-1eb1-46cb-8101-c003e223498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.749441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06314193-1eb1-46cb-8101-c003e223498b admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.749834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06314193-1eb1-46cb-8101-c003e223498b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.750212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06314193-1eb1-46cb-8101-c003e223498b admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.751109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06314193-1eb1-46cb-8101-c003e223498b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.753166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06314193-1eb1-46cb-8101-c003e223498b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.766588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346937dc-15e1-4eed-b39b-d3ee6110cf71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258f3af07bf944e68d72d5d173e9e4b7, user_id=48e81f8fffcf4e6f8b0576ff5359a5f2, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.769281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346937dc-15e1-4eed-b39b-d3ee6110cf71 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:44.787745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1026/2014] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:44 2022] PUT /identity/v3/projects/258f3af07bf944e68d72d5d173e9e4b7/users/48e81f8fffcf4e6f8b0576ff5359a5f2/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:44.798264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be909652-43cb-4916-9f72-6758164de280 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.798655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be909652-43cb-4916-9f72-6758164de280 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.799045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be909652-43cb-4916-9f72-6758164de280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.805948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 989/2015] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:44 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:44.811420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06314193-1eb1-46cb-8101-c003e223498b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.844662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-be909652-43cb-4916-9f72-6758164de280 None None] MFA Rules not processed for user `48e81f8fffcf4e6f8b0576ff5359a5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:44.847829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-be909652-43cb-4916-9f72-6758164de280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:44.964535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1027/2016] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:44.965867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be909652-43cb-4916-9f72-6758164de280 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:44.967824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06314193-1eb1-46cb-8101-c003e223498b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.989080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa926-d044-46d4-b6fa-45f39035820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:44.990033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa926-d044-46d4-b6fa-45f39035820c admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:44.990151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be909652-43cb-4916-9f72-6758164de280 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:44.994878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa926-d044-46d4-b6fa-45f39035820c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:44.995519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa926-d044-46d4-b6fa-45f39035820c admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:44.996443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa926-d044-46d4-b6fa-45f39035820c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:44.999248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa926-d044-46d4-b6fa-45f39035820c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.006865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a0a76-6a47-43bb-ac20-8ba9f1b34a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.008499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0a76-6a47-43bb-ac20-8ba9f1b34a34 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.009255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0a76-6a47-43bb-ac20-8ba9f1b34a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.009956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0a76-6a47-43bb-ac20-8ba9f1b34a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.011636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a0a76-6a47-43bb-ac20-8ba9f1b34a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.016073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a0a76-6a47-43bb-ac20-8ba9f1b34a34 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.033724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 990/2017] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:44 2022] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:45.039954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa926-d044-46d4-b6fa-45f39035820c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.057227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa926-d044-46d4-b6fa-45f39035820c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.061715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1028/2018] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:44 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:45.068265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e45fa-bba9-48a5-a5af-3637eadd1c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.068463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a0a76-6a47-43bb-ac20-8ba9f1b34a34 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.069177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e45fa-bba9-48a5-a5af-3637eadd1c54 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.069471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e45fa-bba9-48a5-a5af-3637eadd1c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.069754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e45fa-bba9-48a5-a5af-3637eadd1c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.070574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e45fa-bba9-48a5-a5af-3637eadd1c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.072257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e45fa-bba9-48a5-a5af-3637eadd1c54 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.083978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:45.086814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 991/2019] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:45.091156 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e45fa-bba9-48a5-a5af-3637eadd1c54 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.109274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e45fa-bba9-48a5-a5af-3637eadd1c54 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.183524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a0a76-6a47-43bb-ac20-8ba9f1b34a34 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.184441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:45.192115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ae840-4140-4cd6-9668-7471d739ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.193454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ae840-4140-4cd6-9668-7471d739ab2e admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.194070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ae840-4140-4cd6-9668-7471d739ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.194664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ae840-4140-4cd6-9668-7471d739ab2e admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.196130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ae840-4140-4cd6-9668-7471d739ab2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.200397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ae840-4140-4cd6-9668-7471d739ab2e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.217501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbe62e-8165-48b2-9a3d-025f8559273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.218627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe62e-8165-48b2-9a3d-025f8559273f admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.219200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe62e-8165-48b2-9a3d-025f8559273f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.219740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe62e-8165-48b2-9a3d-025f8559273f admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.220575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbe62e-8165-48b2-9a3d-025f8559273f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.222645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbe62e-8165-48b2-9a3d-025f8559273f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.246475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1029/2020] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:45 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:45.246594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 992/2021] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:45.246686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ae840-4140-4cd6-9668-7471d739ab2e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.247648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbe62e-8165-48b2-9a3d-025f8559273f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.258122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ae840-4140-4cd6-9668-7471d739ab2e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.263840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbe62e-8165-48b2-9a3d-025f8559273f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.264490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3528c1e-53fa-4b5d-8f1c-9ba36ee38f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.265596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3528c1e-53fa-4b5d-8f1c-9ba36ee38f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.265982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3528c1e-53fa-4b5d-8f1c-9ba36ee38f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.266416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3528c1e-53fa-4b5d-8f1c-9ba36ee38f1c admin admin] PATH_INFO: `/v3/projects/08b4a7826c8e476e8e5a389a3091f519/users/870c591d229843ef83cd996c7ce69706/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.269177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1710a-17ac-4a99-8e74-b730fc6715e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.269818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1710a-17ac-4a99-8e74-b730fc6715e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.270104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1710a-17ac-4a99-8e74-b730fc6715e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.270426 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1710a-17ac-4a99-8e74-b730fc6715e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.271162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1710a-17ac-4a99-8e74-b730fc6715e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.272926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1710a-17ac-4a99-8e74-b730fc6715e2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.287243 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 993/2022] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:45.292095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1710a-17ac-4a99-8e74-b730fc6715e2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.295375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3528c1e-53fa-4b5d-8f1c-9ba36ee38f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b4a7826c8e476e8e5a389a3091f519, user_id=870c591d229843ef83cd996c7ce69706, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.299223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3528c1e-53fa-4b5d-8f1c-9ba36ee38f1c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.306267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1710a-17ac-4a99-8e74-b730fc6715e2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.313273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d726908-6fe8-4917-bbd5-98dfcb8911a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.314602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d726908-6fe8-4917-bbd5-98dfcb8911a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.315076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d726908-6fe8-4917-bbd5-98dfcb8911a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.315668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d726908-6fe8-4917-bbd5-98dfcb8911a5 admin admin] PATH_INFO: `/v3/projects/32bcd338f26a4ea2a3bb76349ac39fe9/users/94a8c3ef95404a8185cd1d58a7237cb0/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.322183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1030/2023] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:45 2022] PUT /identity/v3/projects/08b4a7826c8e476e8e5a389a3091f519/users/870c591d229843ef83cd996c7ce69706/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:45.340753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e83ee2-32c9-469e-af1f-df5ec42f672e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.340995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e83ee2-32c9-469e-af1f-df5ec42f672e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.341250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e83ee2-32c9-469e-af1f-df5ec42f672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.344680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d726908-6fe8-4917-bbd5-98dfcb8911a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bcd338f26a4ea2a3bb76349ac39fe9, user_id=94a8c3ef95404a8185cd1d58a7237cb0, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.347420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d726908-6fe8-4917-bbd5-98dfcb8911a5 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.365739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 994/2024] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:45 2022] PUT /identity/v3/projects/32bcd338f26a4ea2a3bb76349ac39fe9/users/94a8c3ef95404a8185cd1d58a7237cb0/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:45.370498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d726908-6fe8-4917-bbd5-98dfcb8911a5 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.374604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b6e83ee2-32c9-469e-af1f-df5ec42f672e None None] MFA Rules not processed for user `870c591d229843ef83cd996c7ce69706`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:45.375874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b6e83ee2-32c9-469e-af1f-df5ec42f672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:45.452635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d726908-6fe8-4917-bbd5-98dfcb8911a5 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.458266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b2c3-e9b0-49d4-b3ca-0a6998050fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.458976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b2c3-e9b0-49d4-b3ca-0a6998050fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.459268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b2c3-e9b0-49d4-b3ca-0a6998050fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.459551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b2c3-e9b0-49d4-b3ca-0a6998050fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.460289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b2c3-e9b0-49d4-b3ca-0a6998050fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.462074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b2c3-e9b0-49d4-b3ca-0a6998050fb5 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.472114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1031/2025] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:45.477248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e83ee2-32c9-469e-af1f-df5ec42f672e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.482269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 995/2026] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:45.491463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b2c3-e9b0-49d4-b3ca-0a6998050fb5 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.502188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e83ee2-32c9-469e-af1f-df5ec42f672e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.516406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b2c3-e9b0-49d4-b3ca-0a6998050fb5 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.517076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255e18-f025-4934-a0f8-5feab76fe62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.517878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255e18-f025-4934-a0f8-5feab76fe62e admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.518238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255e18-f025-4934-a0f8-5feab76fe62e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.518554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255e18-f025-4934-a0f8-5feab76fe62e admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.519531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255e18-f025-4934-a0f8-5feab76fe62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.521693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255e18-f025-4934-a0f8-5feab76fe62e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.522853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6f739-22a6-4158-82ac-7b9d62f8b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.524136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f739-22a6-4158-82ac-7b9d62f8b328 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.524620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f739-22a6-4158-82ac-7b9d62f8b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.524982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f739-22a6-4158-82ac-7b9d62f8b328 admin admin] PATH_INFO: `/v3/projects/32bcd338f26a4ea2a3bb76349ac39fe9/users/94a8c3ef95404a8185cd1d58a7237cb0/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.527241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6f739-22a6-4158-82ac-7b9d62f8b328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bcd338f26a4ea2a3bb76349ac39fe9, user_id=94a8c3ef95404a8185cd1d58a7237cb0, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.530157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6f739-22a6-4158-82ac-7b9d62f8b328 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.553810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1032/2028] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:45 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:45.555801 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 996/2028] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:45 2022] PUT /identity/v3/projects/32bcd338f26a4ea2a3bb76349ac39fe9/users/94a8c3ef95404a8185cd1d58a7237cb0/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:45.559210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6f739-22a6-4158-82ac-7b9d62f8b328 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.560287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc90365-7783-42e9-90f6-d64265be4468 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.560501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc90365-7783-42e9-90f6-d64265be4468 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.560784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc90365-7783-42e9-90f6-d64265be4468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.599915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3dc90365-7783-42e9-90f6-d64265be4468 None None] MFA Rules not processed for user `94a8c3ef95404a8185cd1d58a7237cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:45.603300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3dc90365-7783-42e9-90f6-d64265be4468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:45.634005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:45.648871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6f739-22a6-4158-82ac-7b9d62f8b328 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.714107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1033/2029] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:45.719589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:45.730363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc90365-7783-42e9-90f6-d64265be4468 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.734008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3dc90365-7783-42e9-90f6-d64265be4468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:45.789812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed79c5-9908-4157-9d05-3cc079399a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.790921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed79c5-9908-4157-9d05-3cc079399a78 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.791355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed79c5-9908-4157-9d05-3cc079399a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.791976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed79c5-9908-4157-9d05-3cc079399a78 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.793140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed79c5-9908-4157-9d05-3cc079399a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.797093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed79c5-9908-4157-9d05-3cc079399a78 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.822828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc90365-7783-42e9-90f6-d64265be4468 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.828313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af9d5c-dfb6-4a09-9f30-428aa09327c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.829076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af9d5c-dfb6-4a09-9f30-428aa09327c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.829435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af9d5c-dfb6-4a09-9f30-428aa09327c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.829840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af9d5c-dfb6-4a09-9f30-428aa09327c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.838695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 997/2030] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:45 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:45.842042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed79c5-9908-4157-9d05-3cc079399a78 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.847675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af9d5c-dfb6-4a09-9f30-428aa09327c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.849868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af9d5c-dfb6-4a09-9f30-428aa09327c7 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.861771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1034/2031] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:45.863912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed79c5-9908-4157-9d05-3cc079399a78 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.873516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ec456-ad15-436b-bb1c-5828a052bb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.875022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ec456-ad15-436b-bb1c-5828a052bb72 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.875372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ec456-ad15-436b-bb1c-5828a052bb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.875808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ec456-ad15-436b-bb1c-5828a052bb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.877020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ec456-ad15-436b-bb1c-5828a052bb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.879805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ec456-ad15-436b-bb1c-5828a052bb72 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.903164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 998/2032] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:45.909851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af9d5c-dfb6-4a09-9f30-428aa09327c7 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:45.931617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af9d5c-dfb6-4a09-9f30-428aa09327c7 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:45.936144 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583edc-f10e-4a1b-a1d0-59b7bb4cb714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:45.937051 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583edc-f10e-4a1b-a1d0-59b7bb4cb714 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:45.937662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583edc-f10e-4a1b-a1d0-59b7bb4cb714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:45.937662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583edc-f10e-4a1b-a1d0-59b7bb4cb714 admin admin] PATH_INFO: `/v3/projects/e52b935598ae4569973b4fba197e333c/users/b28fb18bda9b4d2ebcc0b1efca74e3d6/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:45.955871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583edc-f10e-4a1b-a1d0-59b7bb4cb714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52b935598ae4569973b4fba197e333c, user_id=b28fb18bda9b4d2ebcc0b1efca74e3d6, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:45.958542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583edc-f10e-4a1b-a1d0-59b7bb4cb714 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:45.987368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1035/2033] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:45 2022] PUT /identity/v3/projects/e52b935598ae4569973b4fba197e333c/users/b28fb18bda9b4d2ebcc0b1efca74e3d6/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:45.995401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ec456-ad15-436b-bb1c-5828a052bb72 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:46.025179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ec456-ad15-436b-bb1c-5828a052bb72 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:46.165739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383590b0-8602-4029-8c88-111a94bf4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:46.166851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383590b0-8602-4029-8c88-111a94bf4d0a admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:46.167324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383590b0-8602-4029-8c88-111a94bf4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:46.167791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383590b0-8602-4029-8c88-111a94bf4d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:46.169166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383590b0-8602-4029-8c88-111a94bf4d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:46.172560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383590b0-8602-4029-8c88-111a94bf4d0a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:46.198868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 999/2034] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:46.205860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583edc-f10e-4a1b-a1d0-59b7bb4cb714 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:46.226344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583edc-f10e-4a1b-a1d0-59b7bb4cb714 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:46.238125 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7f419-9efd-4387-9ddd-67e187b032ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:46.240073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f419-9efd-4387-9ddd-67e187b032ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:46.240677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f419-9efd-4387-9ddd-67e187b032ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:46.241283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f419-9efd-4387-9ddd-67e187b032ef admin admin] PATH_INFO: `/v3/projects/e52b935598ae4569973b4fba197e333c/users/b28fb18bda9b4d2ebcc0b1efca74e3d6/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:46.247238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7f419-9efd-4387-9ddd-67e187b032ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52b935598ae4569973b4fba197e333c, user_id=b28fb18bda9b4d2ebcc0b1efca74e3d6, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:46.255542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7f419-9efd-4387-9ddd-67e187b032ef admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:46.310413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1036/2035] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:46 2022] PUT /identity/v3/projects/e52b935598ae4569973b4fba197e333c/users/b28fb18bda9b4d2ebcc0b1efca74e3d6/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:46.314591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcdab4-8fba-4ae1-90a1-2639580b5a9b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:46.315543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcdab4-8fba-4ae1-90a1-2639580b5a9b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:46.316232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcdab4-8fba-4ae1-90a1-2639580b5a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:46.361942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-64dcdab4-8fba-4ae1-90a1-2639580b5a9b None None] MFA Rules not processed for user `b28fb18bda9b4d2ebcc0b1efca74e3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:46.363856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-64dcdab4-8fba-4ae1-90a1-2639580b5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:46.520744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b780-1c8f-48e2-ba56-a796a7f0182a None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:46.521307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b780-1c8f-48e2-ba56-a796a7f0182a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:46.521736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b780-1c8f-48e2-ba56-a796a7f0182a None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:46.523990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1037/2036] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:51:46.540156 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1000/2037] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:46.543886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa84cc-4cdb-4148-a377-efea66bd8a1b None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:46.544273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa84cc-4cdb-4148-a377-efea66bd8a1b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:46.544644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa84cc-4cdb-4148-a377-efea66bd8a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:46.574515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcdab4-8fba-4ae1-90a1-2639580b5a9b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:46.577037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-64dcdab4-8fba-4ae1-90a1-2639580b5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:46.604591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-dafa84cc-4cdb-4148-a377-efea66bd8a1b None None] MFA Rules not processed for user `167e32465f314f4caf9f8df4a4710dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:46.606277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dafa84cc-4cdb-4148-a377-efea66bd8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:46.665644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:46.723529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcdab4-8fba-4ae1-90a1-2639580b5a9b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:46.729627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d47cd-9bdc-434c-a9f5-00e81e1b0c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:46.730595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d47cd-9bdc-434c-a9f5-00e81e1b0c13 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:46.730995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d47cd-9bdc-434c-a9f5-00e81e1b0c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:46.731377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d47cd-9bdc-434c-a9f5-00e81e1b0c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:46.745657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d47cd-9bdc-434c-a9f5-00e81e1b0c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:46.747788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d47cd-9bdc-434c-a9f5-00e81e1b0c13 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:46.770616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1001/2038] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:46.772761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d47cd-9bdc-434c-a9f5-00e81e1b0c13 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:46.775410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1038/2039] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:46.808761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa84cc-4cdb-4148-a377-efea66bd8a1b None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:46.811420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dafa84cc-4cdb-4148-a377-efea66bd8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:46.832582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa84cc-4cdb-4148-a377-efea66bd8a1b None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:46.841228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a1242-f449-48a0-82d6-ac521b41e8a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:46.842240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1242-f449-48a0-82d6-ac521b41e8a4 service placement] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:46.843137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1242-f449-48a0-82d6-ac521b41e8a4 service placement] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:46.843428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1242-f449-48a0-82d6-ac521b41e8a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:46.856322 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a1242-f449-48a0-82d6-ac521b41e8a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:46.859833 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a1242-f449-48a0-82d6-ac521b41e8a4 service placement] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:46.884588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1039/2040] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:46.925789 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d47cd-9bdc-434c-a9f5-00e81e1b0c13 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:46.935460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:46.938227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:46.938449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:46.939544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] PATH_INFO: `/v3/users/48e81f8fffcf4e6f8b0576ff5359a5f2` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:46.941940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e81f8fffcf4e6f8b0576ff5359a5f2)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:46.946271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:47.093507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e81f8fffcf4e6f8b0576ff5359a5f2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:47.116263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e81f8fffcf4e6f8b0576ff5359a5f2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:47.118080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e81f8fffcf4e6f8b0576ff5359a5f2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:47.131634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e81f8fffcf4e6f8b0576ff5359a5f2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:47.149778 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e81f8fffcf4e6f8b0576ff5359a5f2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:47.157896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1002/2041] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:46 2022] DELETE /identity/v3/users/48e81f8fffcf4e6f8b0576ff5359a5f2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:47.165751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31f0bd-905a-4e13-9b86-38ca4e8a69f0 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:47.166305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31f0bd-905a-4e13-9b86-38ca4e8a69f0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:47.166939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31f0bd-905a-4e13-9b86-38ca4e8a69f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:47.195422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ed31f0bd-905a-4e13-9b86-38ca4e8a69f0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:47.196703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ed31f0bd-905a-4e13-9b86-38ca4e8a69f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:47.203502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:47.295438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1040/2042] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:47.306095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:47.307590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:47.373009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31f0bd-905a-4e13-9b86-38ca4e8a69f0 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:47.374591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ed31f0bd-905a-4e13-9b86-38ca4e8a69f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:47.386344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681733fa-2df7-44c8-bbd6-a284b6628b85 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:47.394864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7ad9c-770b-4fb6-a45a-c955c88630a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:47.395930 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7ad9c-770b-4fb6-a45a-c955c88630a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:47.396451 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7ad9c-770b-4fb6-a45a-c955c88630a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:47.397046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7ad9c-770b-4fb6-a45a-c955c88630a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:47.411310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7ad9c-770b-4fb6-a45a-c955c88630a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:47.413472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7ad9c-770b-4fb6-a45a-c955c88630a3 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:47.419992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:47.454194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1003/2043] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:51:47.463709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31f0bd-905a-4e13-9b86-38ca4e8a69f0 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:47.471783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a60078-d85f-4a26-9b8e-e0812399b815 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28fb18bda9b4d2ebcc0b1efca74e3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52b935598ae4569973b4fba197e333c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:47.472546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a60078-d85f-4a26-9b8e-e0812399b815 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:47.472834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a60078-d85f-4a26-9b8e-e0812399b815 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:47.473001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a60078-d85f-4a26-9b8e-e0812399b815 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:47.473816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a60078-d85f-4a26-9b8e-e0812399b815 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:47.474552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a60078-d85f-4a26-9b8e-e0812399b815 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:47.475877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a60078-d85f-4a26-9b8e-e0812399b815 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:47.494485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1041/2044] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:47.497302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7ad9c-770b-4fb6-a45a-c955c88630a3 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:47.518619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7ad9c-770b-4fb6-a45a-c955c88630a3 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:47.530304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4033d-23e4-42f9-bc90-8319a82d482f tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28fb18bda9b4d2ebcc0b1efca74e3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52b935598ae4569973b4fba197e333c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:47.531404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4033d-23e4-42f9-bc90-8319a82d482f tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:47.531825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4033d-23e4-42f9-bc90-8319a82d482f tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:47.532434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4033d-23e4-42f9-bc90-8319a82d482f tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:47.533456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4033d-23e4-42f9-bc90-8319a82d482f tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:47.535594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4033d-23e4-42f9-bc90-8319a82d482f tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:47.612422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1004/2045] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:47 2022] POST /identity/v3/projects => generated 355 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:47.613495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a60078-d85f-4a26-9b8e-e0812399b815 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:47.633156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a60078-d85f-4a26-9b8e-e0812399b815 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:47.730368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4033d-23e4-42f9-bc90-8319a82d482f tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:47.733138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-43e4033d-23e4-42f9-bc90-8319a82d482f tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:47.787199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af5226-49d2-40e7-b991-a8ac29fe2636 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28fb18bda9b4d2ebcc0b1efca74e3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52b935598ae4569973b4fba197e333c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:47.789832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af5226-49d2-40e7-b991-a8ac29fe2636 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:47.790988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af5226-49d2-40e7-b991-a8ac29fe2636 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:47.791771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af5226-49d2-40e7-b991-a8ac29fe2636 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:47.793166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af5226-49d2-40e7-b991-a8ac29fe2636 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:47.794623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af5226-49d2-40e7-b991-a8ac29fe2636 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:47.797663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af5226-49d2-40e7-b991-a8ac29fe2636 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:47.823642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1042/2046] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:51:47.909501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af5226-49d2-40e7-b991-a8ac29fe2636 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:47.925547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af5226-49d2-40e7-b991-a8ac29fe2636 tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:47.936727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28fb18bda9b4d2ebcc0b1efca74e3d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e52b935598ae4569973b4fba197e333c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:47.937812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:47.938209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:47.938597 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] PATH_INFO: `/v3/projects/4358fc98451e425da076c1b3c538fdd5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:47.943703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4033d-23e4-42f9-bc90-8319a82d482f tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:47.945418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4358fc98451e425da076c1b3c538fdd5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:47.950886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:47.955811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:47.958849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:47.959421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:47.961199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] PATH_INFO: `/v3/users/3d6f1d4dc86a48a88f6e027e7fcb4f38` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:47.964648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6f1d4dc86a48a88f6e027e7fcb4f38)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:47.970723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:48.055741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:48.065374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4358fc98451e425da076c1b3c538fdd5', 'request_id': 'req-0d5f4d98-1a07-44fd-81da-44733ad4d25c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.080642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4358fc98451e425da076c1b3c538fdd5', 'request_id': 'req-0d5f4d98-1a07-44fd-81da-44733ad4d25c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.099024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4358fc98451e425da076c1b3c538fdd5', 'request_id': 'req-0d5f4d98-1a07-44fd-81da-44733ad4d25c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.119483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] The token cache is being invalidate because project 4358fc98451e425da076c1b3c538fdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:48.120081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.121081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.127407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1043/2047] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:47 2022] DELETE /identity/v3/projects/4358fc98451e425da076c1b3c538fdd5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:48.127407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:48.127407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:48.142662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6f1d4dc86a48a88f6e027e7fcb4f38'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.181867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6f1d4dc86a48a88f6e027e7fcb4f38'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.182830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6f1d4dc86a48a88f6e027e7fcb4f38'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.192274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6f1d4dc86a48a88f6e027e7fcb4f38'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.209769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6f1d4dc86a48a88f6e027e7fcb4f38'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.228664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1005/2048] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:47 2022] DELETE /identity/v3/users/3d6f1d4dc86a48a88f6e027e7fcb4f38 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:48.279543 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f4d98-1a07-44fd-81da-44733ad4d25c tempest-VolumeQuotaClassesTest-122893381 tempest-VolumeQuotaClassesTest-122893381-project-admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:48.396795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:48.397911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:48.398025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:48.398920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] PATH_INFO: `/v3/projects/258f3af07bf944e68d72d5d173e9e4b7` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:48.400257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258f3af07bf944e68d72d5d173e9e4b7)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:48.402249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:48.481372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258f3af07bf944e68d72d5d173e9e4b7', 'request_id': 'req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.498425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258f3af07bf944e68d72d5d173e9e4b7', 'request_id': 'req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.519340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258f3af07bf944e68d72d5d173e9e4b7', 'request_id': 'req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.530330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:48.532234 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:48.534962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:48.545064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] The token cache is being invalidate because project 258f3af07bf944e68d72d5d173e9e4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:48.557634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.558983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.562470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1044/2049] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:48 2022] DELETE /identity/v3/projects/258f3af07bf944e68d72d5d173e9e4b7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:48.565420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:48.567622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:48.571537 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c764f5-3d63-4b42-bb58-75223cc06f98 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:48.643950 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:48.660572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:48.661817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:48.663456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:48.663983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] PATH_INFO: `/v3/projects/4bfd749ee56c453eae37f0ccc87019e1` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:48.665574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfd749ee56c453eae37f0ccc87019e1)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:48.669106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:48.689332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e40a-4626-4e1d-a7f7-959e78a16f72 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:48.698018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:48.699195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:48.699716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:48.700364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] PATH_INFO: `/v3/users/870c591d229843ef83cd996c7ce69706` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:48.702029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870c591d229843ef83cd996c7ce69706)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:48.704910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:48.774453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfd749ee56c453eae37f0ccc87019e1', 'request_id': 'req-efcdc2c6-59b5-499c-a884-d830f7863f60'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.786417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfd749ee56c453eae37f0ccc87019e1', 'request_id': 'req-efcdc2c6-59b5-499c-a884-d830f7863f60'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.789086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870c591d229843ef83cd996c7ce69706'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.799385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfd749ee56c453eae37f0ccc87019e1', 'request_id': 'req-efcdc2c6-59b5-499c-a884-d830f7863f60'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.814070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870c591d229843ef83cd996c7ce69706'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.815454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870c591d229843ef83cd996c7ce69706'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.817351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] The token cache is being invalidate because project 4bfd749ee56c453eae37f0ccc87019e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:48.817825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.818898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.821846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1006/2050] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:48 2022] DELETE /identity/v3/projects/4bfd749ee56c453eae37f0ccc87019e1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:48.823165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:48.826531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:48.829818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870c591d229843ef83cd996c7ce69706'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.842363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870c591d229843ef83cd996c7ce69706'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:48.850694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1045/2051] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:48 2022] DELETE /identity/v3/users/870c591d229843ef83cd996c7ce69706 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:48.852138 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:48.854410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:48.919075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdc2c6-59b5-499c-a884-d830f7863f60 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:48.950306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54114c-5be4-4bcf-8313-eb0fb552e458 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:48.957014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:48.957959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:48.958192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:48.958526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] PATH_INFO: `/v3/users/e647d093c505401bba6d5de61662f5c9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:48.960077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e647d093c505401bba6d5de61662f5c9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:48.962115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:48.993408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:49.015230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:49.016305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:49.017823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:49.018101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] PATH_INFO: `/v3/users/94a8c3ef95404a8185cd1d58a7237cb0` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:49.019483 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a8c3ef95404a8185cd1d58a7237cb0)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:49.021476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:49.040597 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e647d093c505401bba6d5de61662f5c9'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.061632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e647d093c505401bba6d5de61662f5c9'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.062568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e647d093c505401bba6d5de61662f5c9'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.069049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:49.069958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e647d093c505401bba6d5de61662f5c9'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.079460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4ee0bddd-2d7d-44ae-93fc-4503a3be58b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e647d093c505401bba6d5de61662f5c9'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.085228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a8c3ef95404a8185cd1d58a7237cb0'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.087424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1046/2052] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:48 2022] DELETE /identity/v3/users/e647d093c505401bba6d5de61662f5c9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:49.089034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f9ae-96b4-4941-8388-b01fa95d2b8e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:49.089326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f9ae-96b4-4941-8388-b01fa95d2b8e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:49.089606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f9ae-96b4-4941-8388-b01fa95d2b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:49.109076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a8c3ef95404a8185cd1d58a7237cb0'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.110793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a8c3ef95404a8185cd1d58a7237cb0'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.127758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a8c3ef95404a8185cd1d58a7237cb0'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.132855 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-bb40f9ae-96b4-4941-8388-b01fa95d2b8e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:49.135479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bb40f9ae-96b4-4941-8388-b01fa95d2b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:49.146374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a8c3ef95404a8185cd1d58a7237cb0'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.158796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1007/2053] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:48 2022] DELETE /identity/v3/users/94a8c3ef95404a8185cd1d58a7237cb0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:49.290482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1047/2054] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:49.311390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:49.313849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:49.355040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f9ae-96b4-4941-8388-b01fa95d2b8e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:49.357587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bb40f9ae-96b4-4941-8388-b01fa95d2b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:49.385302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f9ae-96b4-4941-8388-b01fa95d2b8e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:49.488124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556a391-dd2a-47bb-9263-690ce2510fc5 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:49.495836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693f5ca-01eb-4613-953b-6d95159c9576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:49.509808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693f5ca-01eb-4613-953b-6d95159c9576 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:49.510812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693f5ca-01eb-4613-953b-6d95159c9576 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:49.511995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693f5ca-01eb-4613-953b-6d95159c9576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:49.514938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:49.516760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:49.516760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:49.516760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] PATH_INFO: `/v3/projects/d7940004af3c4e32b359ec4a5cff5e7d` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:49.518361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7940004af3c4e32b359ec4a5cff5e7d)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:49.520483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:49.543435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693f5ca-01eb-4613-953b-6d95159c9576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:49.545131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693f5ca-01eb-4613-953b-6d95159c9576 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:49.558782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1008/2055] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:49.591221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:49.609296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7940004af3c4e32b359ec4a5cff5e7d', 'request_id': 'req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.618923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7940004af3c4e32b359ec4a5cff5e7d', 'request_id': 'req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.629528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7940004af3c4e32b359ec4a5cff5e7d', 'request_id': 'req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.644640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] The token cache is being invalidate because project d7940004af3c4e32b359ec4a5cff5e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:49.645103 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.645947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.647955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1048/2056] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:49 2022] DELETE /identity/v3/projects/d7940004af3c4e32b359ec4a5cff5e7d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:49.655109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a973c-1392-41d8-8ba1-2daf12a38fd7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:49.656535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a973c-1392-41d8-8ba1-2daf12a38fd7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:49.657246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a973c-1392-41d8-8ba1-2daf12a38fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:49.691987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-190a973c-1392-41d8-8ba1-2daf12a38fd7 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:49.694451 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-190a973c-1392-41d8-8ba1-2daf12a38fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:49.721885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:49.724064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:49.794694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1009/2057] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:49.803164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac1b3a-af02-448d-b16d-01db4863f5b6 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:49.803458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac1b3a-af02-448d-b16d-01db4863f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:49.803743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac1b3a-af02-448d-b16d-01db4863f5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:49.839929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f9ac1b3a-af02-448d-b16d-01db4863f5b6 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:49.850999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f9ac1b3a-af02-448d-b16d-01db4863f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:49.861413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5605c2-596e-48e3-8b3d-cff4f2fb15c6 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:49.866339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:49.868095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:49.868460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:49.868740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] PATH_INFO: `/v3/projects/32bcd338f26a4ea2a3bb76349ac39fe9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:49.870076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bcd338f26a4ea2a3bb76349ac39fe9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:49.872483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:49.874202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1010/2058] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:49.880468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac1b3a-af02-448d-b16d-01db4863f5b6 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:49.900761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac1b3a-af02-448d-b16d-01db4863f5b6 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:49.909312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec51cf-29bb-47fc-90c6-4e76ff369c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:49.910672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec51cf-29bb-47fc-90c6-4e76ff369c6c admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:49.911244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec51cf-29bb-47fc-90c6-4e76ff369c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:49.911887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec51cf-29bb-47fc-90c6-4e76ff369c6c admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:49.913356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec51cf-29bb-47fc-90c6-4e76ff369c6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:49.913991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec51cf-29bb-47fc-90c6-4e76ff369c6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:49.917303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec51cf-29bb-47fc-90c6-4e76ff369c6c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:49.940114 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1011/2059] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:49.946278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec51cf-29bb-47fc-90c6-4e76ff369c6c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:49.957562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bcd338f26a4ea2a3bb76349ac39fe9', 'request_id': 'req-36a32109-89e2-4873-88c3-dc406412add6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.962546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec51cf-29bb-47fc-90c6-4e76ff369c6c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:49.965945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bcd338f26a4ea2a3bb76349ac39fe9', 'request_id': 'req-36a32109-89e2-4873-88c3-dc406412add6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.978135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bcd338f26a4ea2a3bb76349ac39fe9', 'request_id': 'req-36a32109-89e2-4873-88c3-dc406412add6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.996494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] The token cache is being invalidate because project 32bcd338f26a4ea2a3bb76349ac39fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:49.996779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:49.997751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.000617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1049/2060] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:49 2022] DELETE /identity/v3/projects/32bcd338f26a4ea2a3bb76349ac39fe9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:50.005893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.007991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.023203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:50.062342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e13848-9a2a-4244-a4f9-ec7cb0878c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.063489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e13848-9a2a-4244-a4f9-ec7cb0878c87 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.063980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e13848-9a2a-4244-a4f9-ec7cb0878c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.064450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e13848-9a2a-4244-a4f9-ec7cb0878c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.065790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e13848-9a2a-4244-a4f9-ec7cb0878c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.069230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e13848-9a2a-4244-a4f9-ec7cb0878c87 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.090890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a32109-89e2-4873-88c3-dc406412add6 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.102181 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1012/2061] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:49 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:50.104112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.105335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b8bee-058c-4005-b712-6a46777e40ec None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.105812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b8bee-058c-4005-b712-6a46777e40ec None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.106229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b8bee-058c-4005-b712-6a46777e40ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.106656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.107261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.107581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] PATH_INFO: `/v3/projects/08b4a7826c8e476e8e5a389a3091f519` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.109723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b4a7826c8e476e8e5a389a3091f519)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.112461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.114557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:50.129572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-3e5b8bee-058c-4005-b712-6a46777e40ec None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:50.130874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-3e5b8bee-058c-4005-b712-6a46777e40ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.181286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b4a7826c8e476e8e5a389a3091f519', 'request_id': 'req-f11fa3d5-a7b7-400a-b567-ec44b365fabe'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.188298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b4a7826c8e476e8e5a389a3091f519', 'request_id': 'req-f11fa3d5-a7b7-400a-b567-ec44b365fabe'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.199322 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b4a7826c8e476e8e5a389a3091f519', 'request_id': 'req-f11fa3d5-a7b7-400a-b567-ec44b365fabe'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.210078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1013/2062] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:50.211024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b8bee-058c-4005-b712-6a46777e40ec None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.212307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-3e5b8bee-058c-4005-b712-6a46777e40ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.213924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] The token cache is being invalidate because project 08b4a7826c8e476e8e5a389a3091f519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:50.214223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.214953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-f11fa3d5-a7b7-400a-b567-ec44b365fabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.216797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1050/2063] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:50 2022] DELETE /identity/v3/projects/08b4a7826c8e476e8e5a389a3091f519 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:50.221053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a55d5-702a-4ce8-a19d-2dd59a9fe3f1 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.221445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a55d5-702a-4ce8-a19d-2dd59a9fe3f1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.221610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a55d5-702a-4ce8-a19d-2dd59a9fe3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.225031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b8bee-058c-4005-b712-6a46777e40ec None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.242653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-146a55d5-702a-4ce8-a19d-2dd59a9fe3f1 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:50.244056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-146a55d5-702a-4ce8-a19d-2dd59a9fe3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.285984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5de5d-30dd-4ae1-afe2-6466a18e06ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.286621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5de5d-30dd-4ae1-afe2-6466a18e06ba admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.286901 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5de5d-30dd-4ae1-afe2-6466a18e06ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.287169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5de5d-30dd-4ae1-afe2-6466a18e06ba admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.287851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5de5d-30dd-4ae1-afe2-6466a18e06ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.290316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5de5d-30dd-4ae1-afe2-6466a18e06ba admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.314245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1014/2064] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:50 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:50.315560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5de5d-30dd-4ae1-afe2-6466a18e06ba admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.317633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-73e5de5d-30dd-4ae1-afe2-6466a18e06ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.332031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5de5d-30dd-4ae1-afe2-6466a18e06ba admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.344828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1051/2065] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:50.344828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a55d5-702a-4ce8-a19d-2dd59a9fe3f1 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.345942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-146a55d5-702a-4ce8-a19d-2dd59a9fe3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.347048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.347944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.348232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.348507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] PATH_INFO: `/v3/users/b28fb18bda9b4d2ebcc0b1efca74e3d6` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.349766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28fb18bda9b4d2ebcc0b1efca74e3d6)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.351783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.358123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a55d5-702a-4ce8-a19d-2dd59a9fe3f1 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.362940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f062ea-369a-4762-be6b-60242c002126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.363617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f062ea-369a-4762-be6b-60242c002126 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.363896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f062ea-369a-4762-be6b-60242c002126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.364171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f062ea-369a-4762-be6b-60242c002126 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.364931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f062ea-369a-4762-be6b-60242c002126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.366563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f062ea-369a-4762-be6b-60242c002126 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.377353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1052/2066] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:50.378013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f062ea-369a-4762-be6b-60242c002126 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.389010 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f062ea-369a-4762-be6b-60242c002126 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.394629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ee54b-4a35-4b73-8db5-cbdae69a4bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.395386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ee54b-4a35-4b73-8db5-cbdae69a4bcf admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.395639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ee54b-4a35-4b73-8db5-cbdae69a4bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.395924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ee54b-4a35-4b73-8db5-cbdae69a4bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.396722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ee54b-4a35-4b73-8db5-cbdae69a4bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:50.397021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ee54b-4a35-4b73-8db5-cbdae69a4bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.398795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ee54b-4a35-4b73-8db5-cbdae69a4bcf admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.407768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:50.409882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28fb18bda9b4d2ebcc0b1efca74e3d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.417628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1053/2067] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:50.417628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ee54b-4a35-4b73-8db5-cbdae69a4bcf admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.425011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ee54b-4a35-4b73-8db5-cbdae69a4bcf admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.435878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28fb18bda9b4d2ebcc0b1efca74e3d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.436641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28fb18bda9b4d2ebcc0b1efca74e3d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.441095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8562-8f4e-465e-878e-3f6ee8867aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.444165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8562-8f4e-465e-878e-3f6ee8867aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.444165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8562-8f4e-465e-878e-3f6ee8867aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.444165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8562-8f4e-465e-878e-3f6ee8867aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.444165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8562-8f4e-465e-878e-3f6ee8867aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.444586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28fb18bda9b4d2ebcc0b1efca74e3d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.445684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8562-8f4e-465e-878e-3f6ee8867aa1 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.453860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28fb18bda9b4d2ebcc0b1efca74e3d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:50.461569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1054/2068] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:50.462692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1015/2069] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:50 2022] DELETE /identity/v3/users/b28fb18bda9b4d2ebcc0b1efca74e3d6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:50.462804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8562-8f4e-465e-878e-3f6ee8867aa1 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.466255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.468151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5d5d8562-8f4e-465e-878e-3f6ee8867aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.468331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.490842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8562-8f4e-465e-878e-3f6ee8867aa1 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.580378 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b480e8-163c-4678-8092-4bb6e73cde76 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.589012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:50.589596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5233b91-0fbf-4e66-b4a0-ec436795b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.592371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5233b91-0fbf-4e66-b4a0-ec436795b062 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.592518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5233b91-0fbf-4e66-b4a0-ec436795b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.592825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5233b91-0fbf-4e66-b4a0-ec436795b062 admin admin] PATH_INFO: `/v3/projects/9f2b37eb6dfc45ff8b2044398555799e/users/5fa0f39619154ff5973cfc7cb21b8553/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.605347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d22fa-61ff-43b9-ab64-4b64ccbca452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.606553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d22fa-61ff-43b9-ab64-4b64ccbca452 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.607109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d22fa-61ff-43b9-ab64-4b64ccbca452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.607503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d22fa-61ff-43b9-ab64-4b64ccbca452 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.608440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d22fa-61ff-43b9-ab64-4b64ccbca452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.610559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d22fa-61ff-43b9-ab64-4b64ccbca452 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.611630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5233b91-0fbf-4e66-b4a0-ec436795b062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2b37eb6dfc45ff8b2044398555799e, user_id=5fa0f39619154ff5973cfc7cb21b8553, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.614342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5233b91-0fbf-4e66-b4a0-ec436795b062 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.636139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1016/2070] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:50 2022] PUT /identity/v3/projects/9f2b37eb6dfc45ff8b2044398555799e/users/5fa0f39619154ff5973cfc7cb21b8553/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:50.651461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1055/2071] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:50 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:50.655787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46830-7186-4b4e-baaf-0feec56a45c4 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.656301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46830-7186-4b4e-baaf-0feec56a45c4 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.656381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46830-7186-4b4e-baaf-0feec56a45c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.660980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d22fa-61ff-43b9-ab64-4b64ccbca452 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.692734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-22d46830-7186-4b4e-baaf-0feec56a45c4 None None] MFA Rules not processed for user `5fa0f39619154ff5973cfc7cb21b8553`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:50.694093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-22d46830-7186-4b4e-baaf-0feec56a45c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.764037 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d22fa-61ff-43b9-ab64-4b64ccbca452 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.770171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55c69c-17d6-4bd1-9068-1d8d1827b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.771000 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55c69c-17d6-4bd1-9068-1d8d1827b999 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.771316 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55c69c-17d6-4bd1-9068-1d8d1827b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.771645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55c69c-17d6-4bd1-9068-1d8d1827b999 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.772416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55c69c-17d6-4bd1-9068-1d8d1827b999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.774090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1017/2072] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:50.774457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55c69c-17d6-4bd1-9068-1d8d1827b999 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.788193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d46830-7186-4b4e-baaf-0feec56a45c4 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.789796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-22d46830-7186-4b4e-baaf-0feec56a45c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.818614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1056/2073] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:50 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:50.819611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55c69c-17d6-4bd1-9068-1d8d1827b999 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.838961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55c69c-17d6-4bd1-9068-1d8d1827b999 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.848250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec255f-19b2-4f0b-b09f-ec7bad6a2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.850454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec255f-19b2-4f0b-b09f-ec7bad6a2059 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.854418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec255f-19b2-4f0b-b09f-ec7bad6a2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.854418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec255f-19b2-4f0b-b09f-ec7bad6a2059 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.855828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec255f-19b2-4f0b-b09f-ec7bad6a2059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.857636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec255f-19b2-4f0b-b09f-ec7bad6a2059 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.863055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:50.876067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1057/2074] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:50.877410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec255f-19b2-4f0b-b09f-ec7bad6a2059 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.890225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec255f-19b2-4f0b-b09f-ec7bad6a2059 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.898724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25627295-b3db-4509-a480-031aa5511cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.900022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25627295-b3db-4509-a480-031aa5511cda admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.900529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25627295-b3db-4509-a480-031aa5511cda admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.901118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25627295-b3db-4509-a480-031aa5511cda admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.902294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25627295-b3db-4509-a480-031aa5511cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.903402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d46830-7186-4b4e-baaf-0feec56a45c4 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.903991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25627295-b3db-4509-a480-031aa5511cda admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.907625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313ede7-9353-4ed0-ba03-d5d18bdaa2a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.908281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313ede7-9353-4ed0-ba03-d5d18bdaa2a8 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.908686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313ede7-9353-4ed0-ba03-d5d18bdaa2a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.909534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313ede7-9353-4ed0-ba03-d5d18bdaa2a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.922375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313ede7-9353-4ed0-ba03-d5d18bdaa2a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.924423 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313ede7-9353-4ed0-ba03-d5d18bdaa2a8 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.926654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1058/2075] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:50.930925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25627295-b3db-4509-a480-031aa5511cda admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.933068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-25627295-b3db-4509-a480-031aa5511cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:50.936481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1018/2076] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:50.937304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313ede7-9353-4ed0-ba03-d5d18bdaa2a8 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:50.948268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25627295-b3db-4509-a480-031aa5511cda admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.948489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313ede7-9353-4ed0-ba03-d5d18bdaa2a8 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:50.953441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.953946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9db239-ba2e-4149-b9e3-101c117226e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:50.954577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.954867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.955190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9db239-ba2e-4149-b9e3-101c117226e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:50.955190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9db239-ba2e-4149-b9e3-101c117226e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:50.955432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] PATH_INFO: `/v3/projects/e52b935598ae4569973b4fba197e333c` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.955570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9db239-ba2e-4149-b9e3-101c117226e2 admin admin] PATH_INFO: `/v3/projects/5e47575977e44beea3482b854346b810/users/e20ec6f40c2e49a98f87a745b1f85720/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:50.956364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52b935598ae4569973b4fba197e333c)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.958538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:50.972033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9db239-ba2e-4149-b9e3-101c117226e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e47575977e44beea3482b854346b810, user_id=e20ec6f40c2e49a98f87a745b1f85720, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:50.974739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9db239-ba2e-4149-b9e3-101c117226e2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.002025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1019/2077] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:50 2022] PUT /identity/v3/projects/5e47575977e44beea3482b854346b810/users/e20ec6f40c2e49a98f87a745b1f85720/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:51.004333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c84f9-cd55-4204-bc8d-9f5cd0d465bc None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.004798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c84f9-cd55-4204-bc8d-9f5cd0d465bc None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.005017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c84f9-cd55-4204-bc8d-9f5cd0d465bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.022709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52b935598ae4569973b4fba197e333c', 'request_id': 'req-2a253c34-ee15-4115-b46e-4d074a7cbe40'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.032162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52b935598ae4569973b4fba197e333c', 'request_id': 'req-2a253c34-ee15-4115-b46e-4d074a7cbe40'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.043837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52b935598ae4569973b4fba197e333c', 'request_id': 'req-2a253c34-ee15-4115-b46e-4d074a7cbe40'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.045850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-439c84f9-cd55-4204-bc8d-9f5cd0d465bc None None] MFA Rules not processed for user `e20ec6f40c2e49a98f87a745b1f85720`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:51.048551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-439c84f9-cd55-4204-bc8d-9f5cd0d465bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:51.061032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] The token cache is being invalidate because project e52b935598ae4569973b4fba197e333c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:51.061383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.062069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2a253c34-ee15-4115-b46e-4d074a7cbe40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.063760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1059/2078] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:50 2022] DELETE /identity/v3/projects/e52b935598ae4569973b4fba197e333c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:51.069103 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a3c85-57d6-47b7-8f51-52e2ca74b18c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.069319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a3c85-57d6-47b7-8f51-52e2ca74b18c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.069598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a3c85-57d6-47b7-8f51-52e2ca74b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.097712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-082a3c85-57d6-47b7-8f51-52e2ca74b18c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:51.100112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-082a3c85-57d6-47b7-8f51-52e2ca74b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:51.138420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1020/2079] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:51.139858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c84f9-cd55-4204-bc8d-9f5cd0d465bc None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.141367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-439c84f9-cd55-4204-bc8d-9f5cd0d465bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:51.149169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:51.217746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1060/2080] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:51.218900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a3c85-57d6-47b7-8f51-52e2ca74b18c None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.220474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-082a3c85-57d6-47b7-8f51-52e2ca74b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:51.235719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c84f9-cd55-4204-bc8d-9f5cd0d465bc None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.236148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a3c85-57d6-47b7-8f51-52e2ca74b18c None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.242932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.243178 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66407fff-7edf-4179-80ad-246acd789397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.244034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.244147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407fff-7edf-4179-80ad-246acd789397 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.244254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.244332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407fff-7edf-4179-80ad-246acd789397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.244577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] PATH_INFO: `/v3/users/7b5a3662fe61449bb87e146114bc6f0f` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.244695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407fff-7edf-4179-80ad-246acd789397 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.245189 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66407fff-7edf-4179-80ad-246acd789397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.245954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5a3662fe61449bb87e146114bc6f0f)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.248057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66407fff-7edf-4179-80ad-246acd789397 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.248202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.282225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1061/2081] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:51 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:51.283767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffd2c0-1605-429f-a34e-477bb8e9ad9d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.284081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffd2c0-1605-429f-a34e-477bb8e9ad9d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.284349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffd2c0-1605-429f-a34e-477bb8e9ad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.308977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-6cffd2c0-1605-429f-a34e-477bb8e9ad9d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:51.311574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6cffd2c0-1605-429f-a34e-477bb8e9ad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:51.318681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:51.324031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5a3662fe61449bb87e146114bc6f0f'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.355661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5a3662fe61449bb87e146114bc6f0f'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.356440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5a3662fe61449bb87e146114bc6f0f'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.368605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5a3662fe61449bb87e146114bc6f0f'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.382122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5a3662fe61449bb87e146114bc6f0f'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:51.406464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1021/2082] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:51 2022] DELETE /identity/v3/users/7b5a3662fe61449bb87e146114bc6f0f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:51.409157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.411529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:51.423837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1062/2083] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:51.427341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bf5f9-33cb-46d0-a19f-3bfcd38e0ff9 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.427341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bf5f9-33cb-46d0-a19f-3bfcd38e0ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.427341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bf5f9-33cb-46d0-a19f-3bfcd38e0ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.456038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-302bf5f9-33cb-46d0-a19f-3bfcd38e0ff9 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:51.457272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-302bf5f9-33cb-46d0-a19f-3bfcd38e0ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:51.533342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90864-6727-42f1-9f4f-25654d3fb2cc admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.534766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1063/2084] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:51.535608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bf5f9-33cb-46d0-a19f-3bfcd38e0ff9 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.546693 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58170f57-25ed-44e2-baa8-134b237bacb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.546986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bf5f9-33cb-46d0-a19f-3bfcd38e0ff9 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.548119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58170f57-25ed-44e2-baa8-134b237bacb1 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.548587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58170f57-25ed-44e2-baa8-134b237bacb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.549039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58170f57-25ed-44e2-baa8-134b237bacb1 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.550051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58170f57-25ed-44e2-baa8-134b237bacb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.553261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58170f57-25ed-44e2-baa8-134b237bacb1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.553794 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.555089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.555506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.555790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.556516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:51.556891 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.558510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.575432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1064/2085] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:51.575432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.576651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:51.588856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1022/2086] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:51 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:51.590598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58170f57-25ed-44e2-baa8-134b237bacb1 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.604988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58170f57-25ed-44e2-baa8-134b237bacb1 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.611064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018a2f0-c1cb-4f82-80bb-a0710559caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.611914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018a2f0-c1cb-4f82-80bb-a0710559caeb admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.612190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018a2f0-c1cb-4f82-80bb-a0710559caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.612534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018a2f0-c1cb-4f82-80bb-a0710559caeb admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.613461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018a2f0-c1cb-4f82-80bb-a0710559caeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.616379 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018a2f0-c1cb-4f82-80bb-a0710559caeb admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.642608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:51.654456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1023/2087] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:51 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:51.655685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018a2f0-c1cb-4f82-80bb-a0710559caeb admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.686525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9a210-a80b-4865-87d5-4caa0fc70472 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.741365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018a2f0-c1cb-4f82-80bb-a0710559caeb admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.747001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e066e-1d10-405b-bced-9b98afbc9a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.749236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e066e-1d10-405b-bced-9b98afbc9a5c admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.750037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e066e-1d10-405b-bced-9b98afbc9a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.750331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e066e-1d10-405b-bced-9b98afbc9a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.751183 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e066e-1d10-405b-bced-9b98afbc9a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.752890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e066e-1d10-405b-bced-9b98afbc9a5c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.765101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1024/2088] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:51.766059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e066e-1d10-405b-bced-9b98afbc9a5c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.779911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e066e-1d10-405b-bced-9b98afbc9a5c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.785053 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff480c2-7a50-4776-98cd-6404fdbb82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.785877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff480c2-7a50-4776-98cd-6404fdbb82f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.786924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff480c2-7a50-4776-98cd-6404fdbb82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.787203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff480c2-7a50-4776-98cd-6404fdbb82f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.787934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff480c2-7a50-4776-98cd-6404fdbb82f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.789702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eff546-32af-44d7-9a0d-487b8f9acf43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.790521 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff480c2-7a50-4776-98cd-6404fdbb82f2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.790893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eff546-32af-44d7-9a0d-487b8f9acf43 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.791364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eff546-32af-44d7-9a0d-487b8f9acf43 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.791950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eff546-32af-44d7-9a0d-487b8f9acf43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.808707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eff546-32af-44d7-9a0d-487b8f9acf43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.810957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eff546-32af-44d7-9a0d-487b8f9acf43 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.818856 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1025/2089] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:51 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:51.824079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff480c2-7a50-4776-98cd-6404fdbb82f2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.829034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1065/2090] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:51.831055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eff546-32af-44d7-9a0d-487b8f9acf43 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.837944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff480c2-7a50-4776-98cd-6404fdbb82f2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.845728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eff546-32af-44d7-9a0d-487b8f9acf43 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.845977 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafb130-a960-4a53-a263-5b86e1a65d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.847365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafb130-a960-4a53-a263-5b86e1a65d91 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.848142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafb130-a960-4a53-a263-5b86e1a65d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.850556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafb130-a960-4a53-a263-5b86e1a65d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.851795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafb130-a960-4a53-a263-5b86e1a65d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.851925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572ec51-95ec-4fe0-b341-ab1c80cbd6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.852836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572ec51-95ec-4fe0-b341-ab1c80cbd6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.853235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572ec51-95ec-4fe0-b341-ab1c80cbd6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.853617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572ec51-95ec-4fe0-b341-ab1c80cbd6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.854471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafb130-a960-4a53-a263-5b86e1a65d91 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.854644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572ec51-95ec-4fe0-b341-ab1c80cbd6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.856373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572ec51-95ec-4fe0-b341-ab1c80cbd6b2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.858190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=3,keystone:INSERT=8 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:51.873664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1066/2091] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:51.878610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1026/2092] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:51.879874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572ec51-95ec-4fe0-b341-ab1c80cbd6b2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.880368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafb130-a960-4a53-a263-5b86e1a65d91 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.892767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572ec51-95ec-4fe0-b341-ab1c80cbd6b2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.900073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafb130-a960-4a53-a263-5b86e1a65d91 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.901724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3d7f9-e00b-4ba3-9ace-462746dddcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.902939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3d7f9-e00b-4ba3-9ace-462746dddcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.903213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3d7f9-e00b-4ba3-9ace-462746dddcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.903567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3d7f9-e00b-4ba3-9ace-462746dddcfb admin admin] PATH_INFO: `/v3/projects/8cce34bbd3114e6b920a5813c265147c/users/30d15b08ee9347c08eefd23264efde5d/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.908664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640d87-687b-441c-9f7e-9567db0eede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:51.909824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640d87-687b-441c-9f7e-9567db0eede3 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:51.910297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640d87-687b-441c-9f7e-9567db0eede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:51.910992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8640d87-687b-441c-9f7e-9567db0eede3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:51.912198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8640d87-687b-441c-9f7e-9567db0eede3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.915560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8640d87-687b-441c-9f7e-9567db0eede3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.926640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3d7f9-e00b-4ba3-9ace-462746dddcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cce34bbd3114e6b920a5813c265147c, user_id=30d15b08ee9347c08eefd23264efde5d, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:51.932526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3d7f9-e00b-4ba3-9ace-462746dddcfb admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:51.939179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1027/2093] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:51.946056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640d87-687b-441c-9f7e-9567db0eede3 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:51.970167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8640d87-687b-441c-9f7e-9567db0eede3 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:51.972287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1067/2094] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:51 2022] PUT /identity/v3/projects/8cce34bbd3114e6b920a5813c265147c/users/30d15b08ee9347c08eefd23264efde5d/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:52.003163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774aea-1189-4660-bd1c-1a7ba25e0f92 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.003867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774aea-1189-4660-bd1c-1a7ba25e0f92 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.004443 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774aea-1189-4660-bd1c-1a7ba25e0f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.067213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-35774aea-1189-4660-bd1c-1a7ba25e0f92 None None] MFA Rules not processed for user `30d15b08ee9347c08eefd23264efde5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:52.071552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-35774aea-1189-4660-bd1c-1a7ba25e0f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:52.126057 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f9009-59c8-43d9-8372-b32612dc7781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.127144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f9009-59c8-43d9-8372-b32612dc7781 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.127536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f9009-59c8-43d9-8372-b32612dc7781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.128078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f9009-59c8-43d9-8372-b32612dc7781 admin admin] PATH_INFO: `/v3/projects/83bd65c036dd4610ae359171f30de746/users/7b6f764978f94993ba7a7c4fed688209/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.152374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f9009-59c8-43d9-8372-b32612dc7781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bd65c036dd4610ae359171f30de746, user_id=7b6f764978f94993ba7a7c4fed688209, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.155838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f9009-59c8-43d9-8372-b32612dc7781 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.196298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1028/2095] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:51 2022] PUT /identity/v3/projects/83bd65c036dd4610ae359171f30de746/users/7b6f764978f94993ba7a7c4fed688209/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:52.215502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069216a-97a2-4294-b419-e0bd067d1f05 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.215963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069216a-97a2-4294-b419-e0bd067d1f05 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.216441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069216a-97a2-4294-b419-e0bd067d1f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.234953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1068/2096] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:52.243367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35774aea-1189-4660-bd1c-1a7ba25e0f92 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.265546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d069216a-97a2-4294-b419-e0bd067d1f05 None None] MFA Rules not processed for user `7b6f764978f94993ba7a7c4fed688209`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:52.267265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d069216a-97a2-4294-b419-e0bd067d1f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:52.271620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35774aea-1189-4660-bd1c-1a7ba25e0f92 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:52.368815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1029/2097] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:52.373914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069216a-97a2-4294-b419-e0bd067d1f05 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.388533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:52.414464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09669f6-02db-4b8c-933a-f53b2d977520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.415142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09669f6-02db-4b8c-933a-f53b2d977520 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.415403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09669f6-02db-4b8c-933a-f53b2d977520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.415690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09669f6-02db-4b8c-933a-f53b2d977520 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.416391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09669f6-02db-4b8c-933a-f53b2d977520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.418347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09669f6-02db-4b8c-933a-f53b2d977520 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.456973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1069/2098] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:52 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:52.457835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09669f6-02db-4b8c-933a-f53b2d977520 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.462939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f09669f6-02db-4b8c-933a-f53b2d977520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:52.510707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069216a-97a2-4294-b419-e0bd067d1f05 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:52.517190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:52.556809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09669f6-02db-4b8c-933a-f53b2d977520 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:52.567814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.568860 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.569227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.569584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] PATH_INFO: `/v3/projects/6ad779b4ef144525aa3c0a72f4257c6a` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.571506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad779b4ef144525aa3c0a72f4257c6a)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.573557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.591740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e1f6-624f-484f-aaf9-d517c1814727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.592417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e1f6-624f-484f-aaf9-d517c1814727 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.592724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e1f6-624f-484f-aaf9-d517c1814727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.592983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e1f6-624f-484f-aaf9-d517c1814727 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.593730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6e1f6-624f-484f-aaf9-d517c1814727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.595726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6e1f6-624f-484f-aaf9-d517c1814727 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.632436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1030/2099] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:52 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:52.633971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e1f6-624f-484f-aaf9-d517c1814727 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.638546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad779b4ef144525aa3c0a72f4257c6a', 'request_id': 'req-11a702ef-a729-4a10-bb83-7652967fc750'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:52.646957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad779b4ef144525aa3c0a72f4257c6a', 'request_id': 'req-11a702ef-a729-4a10-bb83-7652967fc750'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:52.656586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad779b4ef144525aa3c0a72f4257c6a', 'request_id': 'req-11a702ef-a729-4a10-bb83-7652967fc750'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:52.669658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] The token cache is being invalidate because project 6ad779b4ef144525aa3c0a72f4257c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:52.670102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:52.671136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:52.675969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1070/2100] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:52 2022] DELETE /identity/v3/projects/6ad779b4ef144525aa3c0a72f4257c6a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:52.675969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.677654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:52.742505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e1f6-624f-484f-aaf9-d517c1814727 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:52.752983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9829e-a79c-4645-8a98-85531aba8562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.753838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9829e-a79c-4645-8a98-85531aba8562 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.754315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9829e-a79c-4645-8a98-85531aba8562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.754812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9829e-a79c-4645-8a98-85531aba8562 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.756014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9829e-a79c-4645-8a98-85531aba8562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.759658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9829e-a79c-4645-8a98-85531aba8562 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.779281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a702ef-a729-4a10-bb83-7652967fc750 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:52.790472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1031/2101] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:52 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:52.790837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72542a-87b3-4350-bb24-b91e6058a3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.791927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfd2ca-16d9-491f-acba-e0993e5b2eec None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.792219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfd2ca-16d9-491f-acba-e0993e5b2eec None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.792500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfd2ca-16d9-491f-acba-e0993e5b2eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.793391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72542a-87b3-4350-bb24-b91e6058a3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.794276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72542a-87b3-4350-bb24-b91e6058a3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.795054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72542a-87b3-4350-bb24-b91e6058a3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.796118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72542a-87b3-4350-bb24-b91e6058a3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.798208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72542a-87b3-4350-bb24-b91e6058a3e9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.810727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:52.812378 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-48dfd2ca-16d9-491f-acba-e0993e5b2eec None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:52.813619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-48dfd2ca-16d9-491f-acba-e0993e5b2eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:52.823327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1032/2102] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:52.828807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1071/2103] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:52 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:52.829073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfd2ca-16d9-491f-acba-e0993e5b2eec None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.829073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-48dfd2ca-16d9-491f-acba-e0993e5b2eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:52.830776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72542a-87b3-4350-bb24-b91e6058a3e9 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.842484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfd2ca-16d9-491f-acba-e0993e5b2eec None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:52.842771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72542a-87b3-4350-bb24-b91e6058a3e9 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:52.847782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d869e-dffd-488a-b921-adcdca39295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.848006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2936e-ffad-4ec5-a4bb-bcea4daa8def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.848621 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d869e-dffd-488a-b921-adcdca39295f admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.848829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2936e-ffad-4ec5-a4bb-bcea4daa8def admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.849028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d869e-dffd-488a-b921-adcdca39295f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.849169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2936e-ffad-4ec5-a4bb-bcea4daa8def admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.849533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d869e-dffd-488a-b921-adcdca39295f admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.849660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2936e-ffad-4ec5-a4bb-bcea4daa8def admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.850287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d869e-dffd-488a-b921-adcdca39295f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.851148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2936e-ffad-4ec5-a4bb-bcea4daa8def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.852078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d869e-dffd-488a-b921-adcdca39295f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.854034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2936e-ffad-4ec5-a4bb-bcea4daa8def admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.863115 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1033/2104] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:52.864486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f7b2-cd6d-474f-87e3-3a965ea9f9a8 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.864777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f7b2-cd6d-474f-87e3-3a965ea9f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.865055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f7b2-cd6d-474f-87e3-3a965ea9f9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.871497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1072/2105] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:52.872500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2936e-ffad-4ec5-a4bb-bcea4daa8def admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.888279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ca82f7b2-cd6d-474f-87e3-3a965ea9f9a8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:52.889595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ca82f7b2-cd6d-474f-87e3-3a965ea9f9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:52.894208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2936e-ffad-4ec5-a4bb-bcea4daa8def admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:52.902985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1034/2106] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:52.902985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f7b2-cd6d-474f-87e3-3a965ea9f9a8 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.906374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3fe7-d8b3-4a95-ace9-1ec507e1b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.907431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3fe7-d8b3-4a95-ace9-1ec507e1b439 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.907836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3fe7-d8b3-4a95-ace9-1ec507e1b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.908286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3fe7-d8b3-4a95-ace9-1ec507e1b439 admin admin] PATH_INFO: `/v3/projects/7c0d1bef6e0546db8ce6987319e5c5a7/users/6c98144bc9e641f79bf2f9a00d07e603/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.910691 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f7b2-cd6d-474f-87e3-3a965ea9f9a8 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:52.916312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f14b5-325a-4968-81c2-e7ce8049aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:52.917214 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f14b5-325a-4968-81c2-e7ce8049aacf admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:52.917496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f14b5-325a-4968-81c2-e7ce8049aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:52.917847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f14b5-325a-4968-81c2-e7ce8049aacf admin admin] PATH_INFO: `/v3/projects/2a5e9a090f1a48ea90b667b1d1c6c872/users/37edafee8fac442bbdf418d85d0c0571/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:52.930591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3fe7-d8b3-4a95-ace9-1ec507e1b439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0d1bef6e0546db8ce6987319e5c5a7, user_id=6c98144bc9e641f79bf2f9a00d07e603, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.935984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3fe7-d8b3-4a95-ace9-1ec507e1b439 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.946634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f14b5-325a-4968-81c2-e7ce8049aacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5e9a090f1a48ea90b667b1d1c6c872, user_id=37edafee8fac442bbdf418d85d0c0571, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:52.951422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f14b5-325a-4968-81c2-e7ce8049aacf admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:52.957976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1073/2107] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:52 2022] PUT /identity/v3/projects/7c0d1bef6e0546db8ce6987319e5c5a7/users/6c98144bc9e641f79bf2f9a00d07e603/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:52.959518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3fe7-d8b3-4a95-ace9-1ec507e1b439 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:52.971735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1035/2108] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:52 2022] PUT /identity/v3/projects/2a5e9a090f1a48ea90b667b1d1c6c872/users/37edafee8fac442bbdf418d85d0c0571/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:52.973545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f14b5-325a-4968-81c2-e7ce8049aacf admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.035608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:53.055909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3fe7-d8b3-4a95-ace9-1ec507e1b439 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.087615 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f14b5-325a-4968-81c2-e7ce8049aacf admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.093624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b6ac-50fe-45f7-8005-532cdd0e9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.094312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b6ac-50fe-45f7-8005-532cdd0e9071 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.094629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b6ac-50fe-45f7-8005-532cdd0e9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.094909 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b6ac-50fe-45f7-8005-532cdd0e9071 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.095713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622b6ac-50fe-45f7-8005-532cdd0e9071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.097341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622b6ac-50fe-45f7-8005-532cdd0e9071 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.110618 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1036/2109] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:53.113259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b6ac-50fe-45f7-8005-532cdd0e9071 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.125751 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b6ac-50fe-45f7-8005-532cdd0e9071 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.131674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9610ad-f748-4707-aa11-f45a82142687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.133096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9610ad-f748-4707-aa11-f45a82142687 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.133531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9610ad-f748-4707-aa11-f45a82142687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.133948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9610ad-f748-4707-aa11-f45a82142687 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.134945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9610ad-f748-4707-aa11-f45a82142687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.136884 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9610ad-f748-4707-aa11-f45a82142687 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.149434 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce76602-a90c-4999-b9ff-9e9deefe20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.150315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce76602-a90c-4999-b9ff-9e9deefe20cb admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.150732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce76602-a90c-4999-b9ff-9e9deefe20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.151107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce76602-a90c-4999-b9ff-9e9deefe20cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.152785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce76602-a90c-4999-b9ff-9e9deefe20cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:53.153161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce76602-a90c-4999-b9ff-9e9deefe20cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.154607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1037/2110] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:53.155596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce76602-a90c-4999-b9ff-9e9deefe20cb admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.157075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9610ad-f748-4707-aa11-f45a82142687 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.161565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ef9610ad-f748-4707-aa11-f45a82142687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:53.178065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1074/2111] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:53.179797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce76602-a90c-4999-b9ff-9e9deefe20cb admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.190235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9610ad-f748-4707-aa11-f45a82142687 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.194315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce76602-a90c-4999-b9ff-9e9deefe20cb admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.197855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.200254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.200808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.201323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] PATH_INFO: `/v3/users/a98f1e9031ef45a988f2a9114a81f114` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.203058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98f1e9031ef45a988f2a9114a81f114)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.203856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f5ac-a0d5-4e00-9878-3c71fcd107a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.205498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f5ac-a0d5-4e00-9878-3c71fcd107a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.205707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.205980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f5ac-a0d5-4e00-9878-3c71fcd107a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.206832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f5ac-a0d5-4e00-9878-3c71fcd107a3 admin admin] PATH_INFO: `/v3/projects/7c0d1bef6e0546db8ce6987319e5c5a7/users/6c98144bc9e641f79bf2f9a00d07e603/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.209943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1f5ac-a0d5-4e00-9878-3c71fcd107a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0d1bef6e0546db8ce6987319e5c5a7, user_id=6c98144bc9e641f79bf2f9a00d07e603, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.215220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1f5ac-a0d5-4e00-9878-3c71fcd107a3 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.232638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1075/2112] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:53 2022] PUT /identity/v3/projects/7c0d1bef6e0546db8ce6987319e5c5a7/users/6c98144bc9e641f79bf2f9a00d07e603/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:53.239482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f5ac-a0d5-4e00-9878-3c71fcd107a3 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.274248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98f1e9031ef45a988f2a9114a81f114'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:53.293372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98f1e9031ef45a988f2a9114a81f114'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:53.294586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98f1e9031ef45a988f2a9114a81f114'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:53.308338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98f1e9031ef45a988f2a9114a81f114'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:53.317628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98f1e9031ef45a988f2a9114a81f114'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:53.317983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:53.326765 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1038/2113] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:53 2022] DELETE /identity/v3/users/a98f1e9031ef45a988f2a9114a81f114 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:53.327667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.329164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:53.341203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f5ac-a0d5-4e00-9878-3c71fcd107a3 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.407880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5cad1-e3de-44ed-939d-a7d6a19026bb admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.412796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493172d-5317-4f18-815e-adef8734458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.413490 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493172d-5317-4f18-815e-adef8734458f admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.414503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493172d-5317-4f18-815e-adef8734458f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.414791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493172d-5317-4f18-815e-adef8734458f admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.414991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c8a63-1b12-4b17-bb4f-74670f61d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.415509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493172d-5317-4f18-815e-adef8734458f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.416108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8a63-1b12-4b17-bb4f-74670f61d287 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.416480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8a63-1b12-4b17-bb4f-74670f61d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.416847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8a63-1b12-4b17-bb4f-74670f61d287 admin admin] PATH_INFO: `/v3/projects/2a5e9a090f1a48ea90b667b1d1c6c872/users/37edafee8fac442bbdf418d85d0c0571/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.417512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493172d-5317-4f18-815e-adef8734458f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.419736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c8a63-1b12-4b17-bb4f-74670f61d287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5e9a090f1a48ea90b667b1d1c6c872, user_id=37edafee8fac442bbdf418d85d0c0571, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.422907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c8a63-1b12-4b17-bb4f-74670f61d287 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.435774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1076/2114] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:53 2022] PUT /identity/v3/projects/2a5e9a090f1a48ea90b667b1d1c6c872/users/37edafee8fac442bbdf418d85d0c0571/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:53.446589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf22c99-6dcc-411e-8bb2-8c7a73dfd9ca None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.446589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf22c99-6dcc-411e-8bb2-8c7a73dfd9ca None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.446589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf22c99-6dcc-411e-8bb2-8c7a73dfd9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.465966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1039/2115] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:53 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:53.467097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4371fbf-b1b4-43ed-af81-3cfb7432e878 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.467487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4371fbf-b1b4-43ed-af81-3cfb7432e878 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.468265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4371fbf-b1b4-43ed-af81-3cfb7432e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.474925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-6cf22c99-6dcc-411e-8bb2-8c7a73dfd9ca None None] MFA Rules not processed for user `6c98144bc9e641f79bf2f9a00d07e603`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:53.475997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6cf22c99-6dcc-411e-8bb2-8c7a73dfd9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:53.492531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d4371fbf-b1b4-43ed-af81-3cfb7432e878 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:53.494450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d4371fbf-b1b4-43ed-af81-3cfb7432e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:53.511883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:53.571624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1077/2116] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:53.572936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b2d69-2812-48a7-9490-63c8f4204e49 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.573229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b2d69-2812-48a7-9490-63c8f4204e49 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.573514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b2d69-2812-48a7-9490-63c8f4204e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.576563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1040/2117] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:53.578031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4371fbf-b1b4-43ed-af81-3cfb7432e878 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.595073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4371fbf-b1b4-43ed-af81-3cfb7432e878 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.601915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761e1b-2b98-4236-bfee-aadc8de5c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.602713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761e1b-2b98-4236-bfee-aadc8de5c04b admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.603062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761e1b-2b98-4236-bfee-aadc8de5c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.603389 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761e1b-2b98-4236-bfee-aadc8de5c04b admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.604170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea761e1b-2b98-4236-bfee-aadc8de5c04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.606642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea761e1b-2b98-4236-bfee-aadc8de5c04b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.609646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-0d1b2d69-2812-48a7-9490-63c8f4204e49 None None] MFA Rules not processed for user `37edafee8fac442bbdf418d85d0c0571`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:53.610752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0d1b2d69-2812-48a7-9490-63c8f4204e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:53.630077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1041/2118] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:53 2022] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:53.631281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761e1b-2b98-4236-bfee-aadc8de5c04b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.636633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ea761e1b-2b98-4236-bfee-aadc8de5c04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:53.689335 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:53.693461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1078/2119] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:53.695638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b2d69-2812-48a7-9490-63c8f4204e49 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.698720 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761e1b-2b98-4236-bfee-aadc8de5c04b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.699901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0d1b2d69-2812-48a7-9490-63c8f4204e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:53.703360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39ba0a-a572-43e1-bcaa-f19dd0aa1479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.704023 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39ba0a-a572-43e1-bcaa-f19dd0aa1479 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.704302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39ba0a-a572-43e1-bcaa-f19dd0aa1479 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.704569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39ba0a-a572-43e1-bcaa-f19dd0aa1479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.715566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39ba0a-a572-43e1-bcaa-f19dd0aa1479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.717015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39ba0a-a572-43e1-bcaa-f19dd0aa1479 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.728413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1042/2120] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:53.730199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39ba0a-a572-43e1-bcaa-f19dd0aa1479 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.739056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39ba0a-a572-43e1-bcaa-f19dd0aa1479 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.746431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03ab03-ff12-40c0-9fae-8a5cc9c84fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.746431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03ab03-ff12-40c0-9fae-8a5cc9c84fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.747709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03ab03-ff12-40c0-9fae-8a5cc9c84fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.747709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03ab03-ff12-40c0-9fae-8a5cc9c84fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.748205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03ab03-ff12-40c0-9fae-8a5cc9c84fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.749684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03ab03-ff12-40c0-9fae-8a5cc9c84fa2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.765600 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1043/2121] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:53.765600 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03ab03-ff12-40c0-9fae-8a5cc9c84fa2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.767539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-9e03ab03-ff12-40c0-9fae-8a5cc9c84fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:53.790364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b2d69-2812-48a7-9490-63c8f4204e49 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.794847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a67995-0d61-435e-95cd-859187d7b25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.795895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a67995-0d61-435e-95cd-859187d7b25e service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.796250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a67995-0d61-435e-95cd-859187d7b25e service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.796632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a67995-0d61-435e-95cd-859187d7b25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.810866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a67995-0d61-435e-95cd-859187d7b25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.812747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a67995-0d61-435e-95cd-859187d7b25e service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.826176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1079/2122] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:53.827245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a67995-0d61-435e-95cd-859187d7b25e service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.841060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a67995-0d61-435e-95cd-859187d7b25e service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.847600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9a058-f251-450c-bacc-3ccca13df338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.848375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a058-f251-450c-bacc-3ccca13df338 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.849106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a058-f251-450c-bacc-3ccca13df338 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.849298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a058-f251-450c-bacc-3ccca13df338 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.850133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9a058-f251-450c-bacc-3ccca13df338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.852778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9a058-f251-450c-bacc-3ccca13df338 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.867178 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1080/2123] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:53.873045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9a058-f251-450c-bacc-3ccca13df338 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.880387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03ab03-ff12-40c0-9fae-8a5cc9c84fa2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.886088 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a077d6-2b9f-460f-88bd-dc2e0c910389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.886662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a077d6-2b9f-460f-88bd-dc2e0c910389 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.886946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a077d6-2b9f-460f-88bd-dc2e0c910389 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.887335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a077d6-2b9f-460f-88bd-dc2e0c910389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.896216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9a058-f251-450c-bacc-3ccca13df338 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.901846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a077d6-2b9f-460f-88bd-dc2e0c910389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.904106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a077d6-2b9f-460f-88bd-dc2e0c910389 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.904678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc8842-8961-4e0a-be09-37e912748a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.905746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8842-8961-4e0a-be09-37e912748a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.906102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8842-8961-4e0a-be09-37e912748a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.906481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8842-8961-4e0a-be09-37e912748a8e admin admin] PATH_INFO: `/v3/projects/e1e8c52f07334beeb35c5aef0b2c56d6/users/f6525af49ffc42269f0883827ccf7e10/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.926441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1044/2124] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:53.927387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a077d6-2b9f-460f-88bd-dc2e0c910389 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:53.939848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc8842-8961-4e0a-be09-37e912748a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e8c52f07334beeb35c5aef0b2c56d6, user_id=f6525af49ffc42269f0883827ccf7e10, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:53.943945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc8842-8961-4e0a-be09-37e912748a8e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:53.950069 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a077d6-2b9f-460f-88bd-dc2e0c910389 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:53.961865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c042a-dd4c-4bf9-91e4-7f7b2128bdf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:53.962557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c042a-dd4c-4bf9-91e4-7f7b2128bdf7 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.962836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c042a-dd4c-4bf9-91e4-7f7b2128bdf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.963250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c042a-dd4c-4bf9-91e4-7f7b2128bdf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:53.966766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a27c042a-dd4c-4bf9-91e4-7f7b2128bdf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:53.974373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1081/2125] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:53 2022] PUT /identity/v3/projects/e1e8c52f07334beeb35c5aef0b2c56d6/users/f6525af49ffc42269f0883827ccf7e10/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:53.979777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8427a5-69ae-4f8a-946e-3508a128f7d9 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:53.980073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8427a5-69ae-4f8a-946e-3508a128f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:53.980959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8427a5-69ae-4f8a-946e-3508a128f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:54.009441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:54.029152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4a8427a5-69ae-4f8a-946e-3508a128f7d9 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:54.031523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4a8427a5-69ae-4f8a-946e-3508a128f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:54.090149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c042a-dd4c-4bf9-91e4-7f7b2128bdf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:54.093904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c042a-dd4c-4bf9-91e4-7f7b2128bdf7 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:54.114987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1045/2126] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:54.192625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1082/2127] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:54.207257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c042a-dd4c-4bf9-91e4-7f7b2128bdf7 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:54.234479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c042a-dd4c-4bf9-91e4-7f7b2128bdf7 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:54.324750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8427a5-69ae-4f8a-946e-3508a128f7d9 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:54.328839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4a8427a5-69ae-4f8a-946e-3508a128f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:54.350757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8427a5-69ae-4f8a-946e-3508a128f7d9 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:54.361515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:54.362433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:54.362719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:54.363753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] PATH_INFO: `/v3/projects/8e4c140ec2cc40619cd5f75a576bf0d1` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:54.365032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4c140ec2cc40619cd5f75a576bf0d1)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:54.367674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:54.434943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c773f6-5c15-4ce7-aaa7-17082354bdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:54.436752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c773f6-5c15-4ce7-aaa7-17082354bdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:54.438780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c773f6-5c15-4ce7-aaa7-17082354bdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:54.438780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c773f6-5c15-4ce7-aaa7-17082354bdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:54.441968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4c140ec2cc40619cd5f75a576bf0d1', 'request_id': 'req-41299f99-48de-40ec-9d6d-298782a6603f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.455003 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4c140ec2cc40619cd5f75a576bf0d1', 'request_id': 'req-41299f99-48de-40ec-9d6d-298782a6603f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.468128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4c140ec2cc40619cd5f75a576bf0d1', 'request_id': 'req-41299f99-48de-40ec-9d6d-298782a6603f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.470177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c773f6-5c15-4ce7-aaa7-17082354bdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:54.471174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:54.471796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c773f6-5c15-4ce7-aaa7-17082354bdb1 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:54.496116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] The token cache is being invalidate because project 8e4c140ec2cc40619cd5f75a576bf0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:54.496412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.497041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1046/2128] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:54.497420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-41299f99-48de-40ec-9d6d-298782a6603f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.498112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c773f6-5c15-4ce7-aaa7-17082354bdb1 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:54.500472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c3c773f6-5c15-4ce7-aaa7-17082354bdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:54.504274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1083/2129] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:54 2022] DELETE /identity/v3/projects/8e4c140ec2cc40619cd5f75a576bf0d1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:54.507719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9376-3c53-46dd-a9c4-95efa9b16497 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:54.508509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9376-3c53-46dd-a9c4-95efa9b16497 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:54.508930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa9376-3c53-46dd-a9c4-95efa9b16497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:54.526268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c773f6-5c15-4ce7-aaa7-17082354bdb1 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:54.535137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-a7aa9376-3c53-46dd-a9c4-95efa9b16497 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:54.536497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a7aa9376-3c53-46dd-a9c4-95efa9b16497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:54.636184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:54.637569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:54.637569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:54.638265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] PATH_INFO: `/v3/users/7b6f764978f94993ba7a7c4fed688209` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:54.639761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6f764978f94993ba7a7c4fed688209)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:54.643041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:54.692449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1084/2130] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:54.701982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d51f44-8ac8-41f3-bcbd-5718348c98d2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:54.702374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d51f44-8ac8-41f3-bcbd-5718348c98d2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:54.702801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d51f44-8ac8-41f3-bcbd-5718348c98d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:54.758733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-89d51f44-8ac8-41f3-bcbd-5718348c98d2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:54.763110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-89d51f44-8ac8-41f3-bcbd-5718348c98d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:54.786836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6f764978f94993ba7a7c4fed688209'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.790225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1085/2131] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:54.796481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d51f44-8ac8-41f3-bcbd-5718348c98d2 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:54.810153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d51f44-8ac8-41f3-bcbd-5718348c98d2 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:54.815809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:54.816509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:54.816915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:54.817204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:54.818439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:54.818439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:54.820481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:54.821130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6f764978f94993ba7a7c4fed688209'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.822584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6f764978f94993ba7a7c4fed688209'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.836974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1086/2132] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:54.841671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:54.842039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6f764978f94993ba7a7c4fed688209'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.843785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:54.849038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:54.862403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aedb7-991e-4a5b-8a2d-4765bf965cd4 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:54.865157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e2769a5f-2d4a-45c5-a2e6-f5b6b17e0d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6f764978f94993ba7a7c4fed688209'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:54.869224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624470b6-6f7c-4a14-9516-25b942f9a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:54.870751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624470b6-6f7c-4a14-9516-25b942f9a74b admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:54.871391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624470b6-6f7c-4a14-9516-25b942f9a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:54.871682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624470b6-6f7c-4a14-9516-25b942f9a74b admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:54.872476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624470b6-6f7c-4a14-9516-25b942f9a74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:54.875284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624470b6-6f7c-4a14-9516-25b942f9a74b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:54.881692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1047/2133] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:54 2022] DELETE /identity/v3/users/7b6f764978f94993ba7a7c4fed688209 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:54.887446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ef3a4-58ce-4b70-a75c-35f638b13342 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:54.888021 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ef3a4-58ce-4b70-a75c-35f638b13342 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:54.888504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ef3a4-58ce-4b70-a75c-35f638b13342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:54.918333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a02ef3a4-58ce-4b70-a75c-35f638b13342 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:54.921082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a02ef3a4-58ce-4b70-a75c-35f638b13342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:54.923090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1087/2134] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:54 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:54.927541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624470b6-6f7c-4a14-9516-25b942f9a74b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:55.049569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624470b6-6f7c-4a14-9516-25b942f9a74b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:55.058016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2905df1-4ce9-42b4-8998-e4beff5b3327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:55.059161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2905df1-4ce9-42b4-8998-e4beff5b3327 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:55.059649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2905df1-4ce9-42b4-8998-e4beff5b3327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:55.060128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2905df1-4ce9-42b4-8998-e4beff5b3327 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:55.061600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2905df1-4ce9-42b4-8998-e4beff5b3327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:55.065621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2905df1-4ce9-42b4-8998-e4beff5b3327 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:55.072318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1048/2135] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:55.084722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ef3a4-58ce-4b70-a75c-35f638b13342 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:55.087880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a02ef3a4-58ce-4b70-a75c-35f638b13342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:55.099073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1088/2136] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:54 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:55.104060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2905df1-4ce9-42b4-8998-e4beff5b3327 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:55.117027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2905df1-4ce9-42b4-8998-e4beff5b3327 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:55.122484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0ca5e-a864-410c-9bd0-f8679246035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:55.123359 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0ca5e-a864-410c-9bd0-f8679246035b admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:55.123947 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0ca5e-a864-410c-9bd0-f8679246035b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:55.124736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0ca5e-a864-410c-9bd0-f8679246035b admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:55.125479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0ca5e-a864-410c-9bd0-f8679246035b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:55.127500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0ca5e-a864-410c-9bd0-f8679246035b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:55.148627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1089/2137] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:55.154963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0ca5e-a864-410c-9bd0-f8679246035b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:55.179394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0ca5e-a864-410c-9bd0-f8679246035b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:55.188346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5599d-a256-4bed-9c74-e9c97ff03cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:55.189477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5599d-a256-4bed-9c74-e9c97ff03cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:55.189978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5599d-a256-4bed-9c74-e9c97ff03cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:55.190530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5599d-a256-4bed-9c74-e9c97ff03cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:55.191968 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5599d-a256-4bed-9c74-e9c97ff03cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:55.195341 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5599d-a256-4bed-9c74-e9c97ff03cd2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:55.206843 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ef3a4-58ce-4b70-a75c-35f638b13342 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:55.213618 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f4ace-eee9-45ed-9dcf-b3e0e7f8898c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:55.214668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4ace-eee9-45ed-9dcf-b3e0e7f8898c service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:55.215290 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4ace-eee9-45ed-9dcf-b3e0e7f8898c service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:55.215732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4ace-eee9-45ed-9dcf-b3e0e7f8898c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:55.226018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1090/2138] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:55.228912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5599d-a256-4bed-9c74-e9c97ff03cd2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:55.234537 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f4ace-eee9-45ed-9dcf-b3e0e7f8898c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:55.236495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f4ace-eee9-45ed-9dcf-b3e0e7f8898c service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:55.249787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1049/2139] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:55.254254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5599d-a256-4bed-9c74-e9c97ff03cd2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:55.260724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1b990-5dde-40ef-bc18-61698da9084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:55.261576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1b990-5dde-40ef-bc18-61698da9084f admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:55.261909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1b990-5dde-40ef-bc18-61698da9084f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:55.262201 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1b990-5dde-40ef-bc18-61698da9084f admin admin] PATH_INFO: `/v3/projects/73b960c678f3478aaaa185b071089be1/users/d6227330f04a42f5b55040d72138cf5a/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:55.294058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1b990-5dde-40ef-bc18-61698da9084f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b960c678f3478aaaa185b071089be1, user_id=d6227330f04a42f5b55040d72138cf5a, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:55.297993 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1b990-5dde-40ef-bc18-61698da9084f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:55.301656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:55.325561 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1091/2140] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:55 2022] PUT /identity/v3/projects/73b960c678f3478aaaa185b071089be1/users/d6227330f04a42f5b55040d72138cf5a/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:55.336641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd746-27f7-4524-b9d3-5a4b3f56d7b4 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:55.336929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd746-27f7-4524-b9d3-5a4b3f56d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:55.337205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dd746-27f7-4524-b9d3-5a4b3f56d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:55.391672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-150dd746-27f7-4524-b9d3-5a4b3f56d7b4 None None] MFA Rules not processed for user `d6227330f04a42f5b55040d72138cf5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:55.393009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-150dd746-27f7-4524-b9d3-5a4b3f56d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:55.492702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1050/2141] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:55.498360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1b990-5dde-40ef-bc18-61698da9084f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:55.695200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1b990-5dde-40ef-bc18-61698da9084f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:55.702285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f4bb7-4cfe-4352-8699-2fe4a63b31be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:55.703291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f4bb7-4cfe-4352-8699-2fe4a63b31be admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:55.704021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f4bb7-4cfe-4352-8699-2fe4a63b31be admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:55.704021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f4bb7-4cfe-4352-8699-2fe4a63b31be admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:55.704596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f4bb7-4cfe-4352-8699-2fe4a63b31be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:55.706980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f4bb7-4cfe-4352-8699-2fe4a63b31be admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:55.754758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1092/2142] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:55 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:55.755104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dd746-27f7-4524-b9d3-5a4b3f56d7b4 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:55.770294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dd746-27f7-4524-b9d3-5a4b3f56d7b4 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:55.835083 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:55.929869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5781e-4780-4730-9ce1-d94d6cb03d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:55.943662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5781e-4780-4730-9ce1-d94d6cb03d95 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:55.943662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5781e-4780-4730-9ce1-d94d6cb03d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:55.944128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5781e-4780-4730-9ce1-d94d6cb03d95 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:55.945157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5781e-4780-4730-9ce1-d94d6cb03d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:55.949993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5781e-4780-4730-9ce1-d94d6cb03d95 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:56.002826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1051/2143] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:55 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:51:56.004072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f4bb7-4cfe-4352-8699-2fe4a63b31be admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:56.012359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc76e6-f668-41da-86bf-b0bc5bcfef88 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:56.014668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc76e6-f668-41da-86bf-b0bc5bcfef88 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:56.016451 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc76e6-f668-41da-86bf-b0bc5bcfef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:56.035309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f4bb7-4cfe-4352-8699-2fe4a63b31be admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:56.050854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8212d2-26cc-4b76-9a15-327fe21eb1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:56.052023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8212d2-26cc-4b76-9a15-327fe21eb1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:56.052502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8212d2-26cc-4b76-9a15-327fe21eb1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:56.057487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8212d2-26cc-4b76-9a15-327fe21eb1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:56.058991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8212d2-26cc-4b76-9a15-327fe21eb1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:56.061793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8212d2-26cc-4b76-9a15-327fe21eb1a9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:56.105553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7edc76e6-f668-41da-86bf-b0bc5bcfef88 None None] MFA Rules not processed for user `f6525af49ffc42269f0883827ccf7e10`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:56.108654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7edc76e6-f668-41da-86bf-b0bc5bcfef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:56.112338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1093/2144] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:56.117504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8212d2-26cc-4b76-9a15-327fe21eb1a9 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:56.159690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8212d2-26cc-4b76-9a15-327fe21eb1a9 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:56.171857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c776ac-923f-4b5d-baac-3b6c9c75ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:56.173678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c776ac-923f-4b5d-baac-3b6c9c75ff13 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:56.174492 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c776ac-923f-4b5d-baac-3b6c9c75ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:56.175168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c776ac-923f-4b5d-baac-3b6c9c75ff13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:56.180107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c776ac-923f-4b5d-baac-3b6c9c75ff13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:56.185417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c776ac-923f-4b5d-baac-3b6c9c75ff13 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:56.211161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1094/2145] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:56.211161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c776ac-923f-4b5d-baac-3b6c9c75ff13 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:56.214369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a4c776ac-923f-4b5d-baac-3b6c9c75ff13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:56.245825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c776ac-923f-4b5d-baac-3b6c9c75ff13 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:56.257452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:56.258854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:56.259274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:56.260244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] PATH_INFO: `/v3/projects/83bd65c036dd4610ae359171f30de746` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:56.270483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bd65c036dd4610ae359171f30de746)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:56.283350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:56.313708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1052/2146] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:56.313708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc76e6-f668-41da-86bf-b0bc5bcfef88 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:56.332847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc76e6-f668-41da-86bf-b0bc5bcfef88 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:56.340135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17092e-7bbd-4928-a067-c48cfcd426c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:56.341360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17092e-7bbd-4928-a067-c48cfcd426c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:56.341848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17092e-7bbd-4928-a067-c48cfcd426c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:56.342169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17092e-7bbd-4928-a067-c48cfcd426c8 admin admin] PATH_INFO: `/v3/projects/5c4e37c1d445418b9daa07a6ff14af3b/users/8d09c90ac3424927b641ede8fc15af4a/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:56.370358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17092e-7bbd-4928-a067-c48cfcd426c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4e37c1d445418b9daa07a6ff14af3b, user_id=8d09c90ac3424927b641ede8fc15af4a, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:56.374161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17092e-7bbd-4928-a067-c48cfcd426c8 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:56.392042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bd65c036dd4610ae359171f30de746', 'request_id': 'req-1023b682-a54c-48cc-abba-65435b91192c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.401040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1053/2147] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:56 2022] PUT /identity/v3/projects/5c4e37c1d445418b9daa07a6ff14af3b/users/8d09c90ac3424927b641ede8fc15af4a/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:56.412626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17092e-7bbd-4928-a067-c48cfcd426c8 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:56.412626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0f17092e-7bbd-4928-a067-c48cfcd426c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:56.412838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bd65c036dd4610ae359171f30de746', 'request_id': 'req-1023b682-a54c-48cc-abba-65435b91192c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.430305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bd65c036dd4610ae359171f30de746', 'request_id': 'req-1023b682-a54c-48cc-abba-65435b91192c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.446546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] The token cache is being invalidate because project 83bd65c036dd4610ae359171f30de746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:56.446840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.447583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1023b682-a54c-48cc-abba-65435b91192c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.449388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1095/2148] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:56 2022] DELETE /identity/v3/projects/83bd65c036dd4610ae359171f30de746 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:56.450749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df651ff1-4fef-4a2d-8d75-0682118409f5 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:56.451698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df651ff1-4fef-4a2d-8d75-0682118409f5 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:56.451986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df651ff1-4fef-4a2d-8d75-0682118409f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:56.485941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-df651ff1-4fef-4a2d-8d75-0682118409f5 None None] MFA Rules not processed for user `8d09c90ac3424927b641ede8fc15af4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:56.487248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-df651ff1-4fef-4a2d-8d75-0682118409f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:56.509573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17092e-7bbd-4928-a067-c48cfcd426c8 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:56.519090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:56.520509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:56.520951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:56.522310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:56.526094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:56.540133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:56.597411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:56.603549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1096/2149] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:56.605167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df651ff1-4fef-4a2d-8d75-0682118409f5 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:56.606595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-df651ff1-4fef-4a2d-8d75-0682118409f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:56.654546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:56.654546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:56.665849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1054/2150] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:56.667579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:56.669655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:56.741854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df651ff1-4fef-4a2d-8d75-0682118409f5 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:56.752059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:56.753995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:56.755249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:56.755694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] PATH_INFO: `/v3/users/37edafee8fac442bbdf418d85d0c0571` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:56.757517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37edafee8fac442bbdf418d85d0c0571)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:56.761038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:56.807440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca49e61-6168-4ead-b6bd-56b46dd73c95 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:56.820320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdbddd-9b5b-4817-aa1d-161e5236992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:56.822012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdbddd-9b5b-4817-aa1d-161e5236992a admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:56.823170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdbddd-9b5b-4817-aa1d-161e5236992a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:56.823543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdbddd-9b5b-4817-aa1d-161e5236992a admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:56.824274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdbddd-9b5b-4817-aa1d-161e5236992a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:56.828306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdbddd-9b5b-4817-aa1d-161e5236992a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:56.862411 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37edafee8fac442bbdf418d85d0c0571'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.869449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1055/2151] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:56 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:56.870407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdbddd-9b5b-4817-aa1d-161e5236992a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:56.884361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37edafee8fac442bbdf418d85d0c0571'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.885300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37edafee8fac442bbdf418d85d0c0571'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.895500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37edafee8fac442bbdf418d85d0c0571'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.910994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37edafee8fac442bbdf418d85d0c0571'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:56.924249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1097/2152] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:56 2022] DELETE /identity/v3/users/37edafee8fac442bbdf418d85d0c0571 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:56.976692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdbddd-9b5b-4817-aa1d-161e5236992a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:57.112993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bbff9-042c-43d1-a52c-f435717b23ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:57.113625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bbff9-042c-43d1-a52c-f435717b23ee admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:57.113953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bbff9-042c-43d1-a52c-f435717b23ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:57.114322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bbff9-042c-43d1-a52c-f435717b23ee admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:57.115646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bbff9-042c-43d1-a52c-f435717b23ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:57.119475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bbff9-042c-43d1-a52c-f435717b23ee admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:57.145056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:57.163781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1056/2153] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:56 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:57.165419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:57.169034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:57.188800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e325d09-b2ca-48a5-81d1-ed4a1282ba27 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:57.197847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb7db-36e7-49ac-9198-94c5564be8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:57.199172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb7db-36e7-49ac-9198-94c5564be8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:57.199911 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb7db-36e7-49ac-9198-94c5564be8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:57.201257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb7db-36e7-49ac-9198-94c5564be8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:57.202682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eb7db-36e7-49ac-9198-94c5564be8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:57.207933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eb7db-36e7-49ac-9198-94c5564be8b9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:57.258881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1098/2154] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:57.263958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bbff9-042c-43d1-a52c-f435717b23ee admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:57.292845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bbff9-042c-43d1-a52c-f435717b23ee admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:57.305127 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439c10c-426d-4c84-8482-03bfea80a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:57.307224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c10c-426d-4c84-8482-03bfea80a783 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:57.308388 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c10c-426d-4c84-8482-03bfea80a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:57.309106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439c10c-426d-4c84-8482-03bfea80a783 admin admin] PATH_INFO: `/v3/projects/329a15ca31da4d2f8148389b9125c6bb/users/fcd99ce93ccf4665bdfa1952c04c1abd/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:57.347347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439c10c-426d-4c84-8482-03bfea80a783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329a15ca31da4d2f8148389b9125c6bb, user_id=fcd99ce93ccf4665bdfa1952c04c1abd, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:57.357654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439c10c-426d-4c84-8482-03bfea80a783 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:57.396746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1057/2155] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:57 2022] PUT /identity/v3/projects/329a15ca31da4d2f8148389b9125c6bb/users/fcd99ce93ccf4665bdfa1952c04c1abd/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:57.404799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb7db-36e7-49ac-9198-94c5564be8b9 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:57.461440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb7db-36e7-49ac-9198-94c5564be8b9 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:57.502372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439c10c-426d-4c84-8482-03bfea80a783 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:57.508444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7439c10c-426d-4c84-8482-03bfea80a783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:57.548798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:57.640945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba6c77-f88b-451b-93ca-11b972ce5b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:57.642245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba6c77-f88b-451b-93ca-11b972ce5b17 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:57.643199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba6c77-f88b-451b-93ca-11b972ce5b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:57.643682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba6c77-f88b-451b-93ca-11b972ce5b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:57.644762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba6c77-f88b-451b-93ca-11b972ce5b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:57.649209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba6c77-f88b-451b-93ca-11b972ce5b17 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:57.670584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439c10c-426d-4c84-8482-03bfea80a783 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:57.680287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:57.681340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1099/2156] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:57.681853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:57.682158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:57.682469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] PATH_INFO: `/v3/projects/2a5e9a090f1a48ea90b667b1d1c6c872` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:57.683888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5e9a090f1a48ea90b667b1d1c6c872)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:57.686138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:57.686879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba6c77-f88b-451b-93ca-11b972ce5b17 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:57.718414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba6c77-f88b-451b-93ca-11b972ce5b17 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:57.749838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ef01-8d14-4218-b12d-ed04c5801ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:57.753425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ef01-8d14-4218-b12d-ed04c5801ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:57.754211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ef01-8d14-4218-b12d-ed04c5801ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:57.754996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ef01-8d14-4218-b12d-ed04c5801ae1 admin admin] PATH_INFO: `/v3/projects/329a15ca31da4d2f8148389b9125c6bb/users/fcd99ce93ccf4665bdfa1952c04c1abd/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:57.760355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3ef01-8d14-4218-b12d-ed04c5801ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329a15ca31da4d2f8148389b9125c6bb, user_id=fcd99ce93ccf4665bdfa1952c04c1abd, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:57.767236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3ef01-8d14-4218-b12d-ed04c5801ae1 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:57.784537 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5e9a090f1a48ea90b667b1d1c6c872', 'request_id': 'req-81832b92-05b9-46b8-b1ce-755222753208'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:57.793849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1100/2157] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:57 2022] PUT /identity/v3/projects/329a15ca31da4d2f8148389b9125c6bb/users/fcd99ce93ccf4665bdfa1952c04c1abd/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:57.804328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5e9a090f1a48ea90b667b1d1c6c872', 'request_id': 'req-81832b92-05b9-46b8-b1ce-755222753208'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:57.806433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edc0c5-27d1-4582-8e85-7f9e9acc2fc1 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:57.807384 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edc0c5-27d1-4582-8e85-7f9e9acc2fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:57.807857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edc0c5-27d1-4582-8e85-7f9e9acc2fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:57.826643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5e9a090f1a48ea90b667b1d1c6c872', 'request_id': 'req-81832b92-05b9-46b8-b1ce-755222753208'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:57.849261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] The token cache is being invalidate because project 2a5e9a090f1a48ea90b667b1d1c6c872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:57.850029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:57.852476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:57.856126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1058/2158] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:57 2022] DELETE /identity/v3/projects/2a5e9a090f1a48ea90b667b1d1c6c872 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:57.857767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:57.860213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:57.867900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-84edc0c5-27d1-4582-8e85-7f9e9acc2fc1 None None] MFA Rules not processed for user `fcd99ce93ccf4665bdfa1952c04c1abd`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:57.871018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-84edc0c5-27d1-4582-8e85-7f9e9acc2fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:57.961952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81832b92-05b9-46b8-b1ce-755222753208 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:57.975988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:57.988217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1101/2159] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:51:57.990630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0be170-f970-4f54-bfd4-af5a2057f49f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:57.991130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0be170-f970-4f54-bfd4-af5a2057f49f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:57.992156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0be170-f970-4f54-bfd4-af5a2057f49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.021520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3c0be170-f970-4f54-bfd4-af5a2057f49f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:58.022710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3c0be170-f970-4f54-bfd4-af5a2057f49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:58.051630 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:58.052563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.052844 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.053239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] PATH_INFO: `/v3/users/e20ec6f40c2e49a98f87a745b1f85720` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.055468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20ec6f40c2e49a98f87a745b1f85720)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:58.057957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:58.096697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1102/2160] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:58.098637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0be170-f970-4f54-bfd4-af5a2057f49f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:58.100173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3c0be170-f970-4f54-bfd4-af5a2057f49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:58.123311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20ec6f40c2e49a98f87a745b1f85720'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:58.142512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20ec6f40c2e49a98f87a745b1f85720'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:58.143305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20ec6f40c2e49a98f87a745b1f85720'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:58.152820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20ec6f40c2e49a98f87a745b1f85720'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:58.161658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-34a121b8-70e2-4702-8c6a-bf6ef8acf8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20ec6f40c2e49a98f87a745b1f85720'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:58.171715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1059/2161] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:57 2022] DELETE /identity/v3/users/e20ec6f40c2e49a98f87a745b1f85720 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:58.171715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e4cf-d34d-49fc-956c-940dd130de5e None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.171715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e4cf-d34d-49fc-956c-940dd130de5e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.171715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e4cf-d34d-49fc-956c-940dd130de5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.174637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:58.180094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0be170-f970-4f54-bfd4-af5a2057f49f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:58.190785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c2b9e4cf-d34d-49fc-956c-940dd130de5e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:58.192054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c2b9e4cf-d34d-49fc-956c-940dd130de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:58.243565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6759e4-5256-400f-b3c2-cab9990a83f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:58.244404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6759e4-5256-400f-b3c2-cab9990a83f8 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.244687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6759e4-5256-400f-b3c2-cab9990a83f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.244961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6759e4-5256-400f-b3c2-cab9990a83f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.246899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-be6759e4-5256-400f-b3c2-cab9990a83f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:58.272717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1060/2162] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:58.273829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1e058-6b7d-42b1-9687-989719bdb436 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.274162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1e058-6b7d-42b1-9687-989719bdb436 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.274651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1e058-6b7d-42b1-9687-989719bdb436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.296549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-abc1e058-6b7d-42b1-9687-989719bdb436 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:58.297752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-abc1e058-6b7d-42b1-9687-989719bdb436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:58.306318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1061/2163] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:58.307140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1e058-6b7d-42b1-9687-989719bdb436 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:58.317699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1e058-6b7d-42b1-9687-989719bdb436 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:58.323259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:58.323820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.324123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.324644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.325070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:51:58.325381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:58.327060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:58.346857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1062/2164] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:51:58.348083 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:58.351701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6759e4-5256-400f-b3c2-cab9990a83f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:58.352172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:58.353149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6759e4-5256-400f-b3c2-cab9990a83f8 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:58.365776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1103/2165] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:58.367279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6759e4-5256-400f-b3c2-cab9990a83f8 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:58.376283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:58.401086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6759e4-5256-400f-b3c2-cab9990a83f8 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:58.408946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565839d-6c9a-4ac1-b1bb-fedd1300ca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:58.409637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565839d-6c9a-4ac1-b1bb-fedd1300ca5a admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.409925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565839d-6c9a-4ac1-b1bb-fedd1300ca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.410204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565839d-6c9a-4ac1-b1bb-fedd1300ca5a admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.410950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565839d-6c9a-4ac1-b1bb-fedd1300ca5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:58.414149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565839d-6c9a-4ac1-b1bb-fedd1300ca5a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:58.438995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff8527-221a-4848-8748-2bd40e021953 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:58.443671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564eb1-2828-43cc-bf60-995e818b369e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:58.445191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564eb1-2828-43cc-bf60-995e818b369e service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.445480 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564eb1-2828-43cc-bf60-995e818b369e service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.445969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564eb1-2828-43cc-bf60-995e818b369e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.447403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1104/2166] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:58 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:58.448723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7ff7-e293-4a92-8f28-b80f24d5fd93 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.449015 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7ff7-e293-4a92-8f28-b80f24d5fd93 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.449293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7ff7-e293-4a92-8f28-b80f24d5fd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.457190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3564eb1-2828-43cc-bf60-995e818b369e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:58.459546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3564eb1-2828-43cc-bf60-995e818b369e service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:58.467942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ab3f7ff7-e293-4a92-8f28-b80f24d5fd93 None None] MFA Rules not processed for user `f6525af49ffc42269f0883827ccf7e10`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:58.469166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ab3f7ff7-e293-4a92-8f28-b80f24d5fd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:58.470750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1063/2167] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:51:58.471662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564eb1-2828-43cc-bf60-995e818b369e service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:58.486635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564eb1-2828-43cc-bf60-995e818b369e service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:58.562062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1105/2168] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:58.624167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f974-82f8-4b91-9747-e527ab188121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:58.625422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f974-82f8-4b91-9747-e527ab188121 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.625848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f974-82f8-4b91-9747-e527ab188121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.626456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f974-82f8-4b91-9747-e527ab188121 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.627989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950f974-82f8-4b91-9747-e527ab188121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:58.630371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950f974-82f8-4b91-9747-e527ab188121 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:58.667486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1064/2169] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:58 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:58.673184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7ff7-e293-4a92-8f28-b80f24d5fd93 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:58.686572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7ff7-e293-4a92-8f28-b80f24d5fd93 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:58.692014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4ed1-5a86-462f-a9f2-ac5a25f8bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:58.692826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4ed1-5a86-462f-a9f2-ac5a25f8bcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.693421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4ed1-5a86-462f-a9f2-ac5a25f8bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.694176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4ed1-5a86-462f-a9f2-ac5a25f8bcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.695386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd4ed1-5a86-462f-a9f2-ac5a25f8bcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:58.697231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd4ed1-5a86-462f-a9f2-ac5a25f8bcb4 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:58.717211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1106/2170] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:58.721471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f974-82f8-4b91-9747-e527ab188121 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:58.742965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f974-82f8-4b91-9747-e527ab188121 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:58.750372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c2872-d4a4-4509-a815-aff1a58e1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:58.751098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2872-d4a4-4509-a815-aff1a58e1c0f admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.751451 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2872-d4a4-4509-a815-aff1a58e1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.751698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2872-d4a4-4509-a815-aff1a58e1c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.752528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c2872-d4a4-4509-a815-aff1a58e1c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:58.754646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c2872-d4a4-4509-a815-aff1a58e1c0f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:58.800573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1065/2171] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:51:58.804810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4ed1-5a86-462f-a9f2-ac5a25f8bcb4 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:58.817185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4ed1-5a86-462f-a9f2-ac5a25f8bcb4 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:58.834250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42f6b8-2923-4423-86f0-c4bc67dce382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:58.835273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42f6b8-2923-4423-86f0-c4bc67dce382 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.835558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42f6b8-2923-4423-86f0-c4bc67dce382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.835837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42f6b8-2923-4423-86f0-c4bc67dce382 admin admin] PATH_INFO: `/v3/projects/7b08199b012e4add8dbe5a3cac2f99e8/users/5074e965dd12490ab2d133637da99e24/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.859691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42f6b8-2923-4423-86f0-c4bc67dce382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b08199b012e4add8dbe5a3cac2f99e8, user_id=5074e965dd12490ab2d133637da99e24, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:58.865547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42f6b8-2923-4423-86f0-c4bc67dce382 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:58.907992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1107/2172] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:58 2022] PUT /identity/v3/projects/7b08199b012e4add8dbe5a3cac2f99e8/users/5074e965dd12490ab2d133637da99e24/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:58.922278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b28714-7d5f-460e-8b45-1a4287f29d1a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:58.922832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b28714-7d5f-460e-8b45-1a4287f29d1a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:58.923332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b28714-7d5f-460e-8b45-1a4287f29d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:58.986204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42f6b8-2923-4423-86f0-c4bc67dce382 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:58.988085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1a42f6b8-2923-4423-86f0-c4bc67dce382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:58.993108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-84b28714-7d5f-460e-8b45-1a4287f29d1a None None] MFA Rules not processed for user `5074e965dd12490ab2d133637da99e24`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:51:58.994913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-84b28714-7d5f-460e-8b45-1a4287f29d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:58.997028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:59.112587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42f6b8-2923-4423-86f0-c4bc67dce382 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:59.118627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:59.119867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:59.120855 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:59.121150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] PATH_INFO: `/v3/projects/5e47575977e44beea3482b854346b810` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:59.122687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e47575977e44beea3482b854346b810)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:59.124719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:59.149354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1066/2173] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:51:59.155020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b28714-7d5f-460e-8b45-1a4287f29d1a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:59.172507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b28714-7d5f-460e-8b45-1a4287f29d1a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:59.181419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f563b-91ec-4e0b-a91d-6c446cddd6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:59.182764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f563b-91ec-4e0b-a91d-6c446cddd6bc admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:59.183180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f563b-91ec-4e0b-a91d-6c446cddd6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:59.183699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f563b-91ec-4e0b-a91d-6c446cddd6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:59.184920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f563b-91ec-4e0b-a91d-6c446cddd6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:59.189615 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f563b-91ec-4e0b-a91d-6c446cddd6bc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:59.207085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e47575977e44beea3482b854346b810', 'request_id': 'req-4e2caee6-f8ca-40ec-9f51-a84a5d197526'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.215479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e47575977e44beea3482b854346b810', 'request_id': 'req-4e2caee6-f8ca-40ec-9f51-a84a5d197526'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.225457 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:59.230414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e47575977e44beea3482b854346b810', 'request_id': 'req-4e2caee6-f8ca-40ec-9f51-a84a5d197526'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.242470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1067/2174] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:51:59 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:59.245684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f563b-91ec-4e0b-a91d-6c446cddd6bc admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:59.249007 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] The token cache is being invalidate because project 5e47575977e44beea3482b854346b810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:51:59.249289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.250114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.252378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1108/2175] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:51:58 2022] DELETE /identity/v3/projects/5e47575977e44beea3482b854346b810 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:59.257773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:59.260899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:59.369367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f563b-91ec-4e0b-a91d-6c446cddd6bc admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:59.375195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866fb33-ceab-490a-89e5-377fe0095b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:59.375881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866fb33-ceab-490a-89e5-377fe0095b9f admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:59.376162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866fb33-ceab-490a-89e5-377fe0095b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:59.376552 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866fb33-ceab-490a-89e5-377fe0095b9f admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:59.377257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866fb33-ceab-490a-89e5-377fe0095b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:59.379559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866fb33-ceab-490a-89e5-377fe0095b9f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:59.380582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2caee6-f8ca-40ec-9f51-a84a5d197526 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:59.386329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:59.387458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:59.388182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:59.388621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] PATH_INFO: `/v3/users/30d15b08ee9347c08eefd23264efde5d` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:59.390464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d15b08ee9347c08eefd23264efde5d)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:59.393101 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:59.411335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1068/2176] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:51:59 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:51:59.415943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866fb33-ceab-490a-89e5-377fe0095b9f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:59.420119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5866fb33-ceab-490a-89e5-377fe0095b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:59.454165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866fb33-ceab-490a-89e5-377fe0095b9f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:59.468914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5cb7-8b94-4083-b999-24cbae805945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:59.469599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5cb7-8b94-4083-b999-24cbae805945 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:59.469880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5cb7-8b94-4083-b999-24cbae805945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:59.470154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5cb7-8b94-4083-b999-24cbae805945 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:59.470937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5cb7-8b94-4083-b999-24cbae805945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:59.473182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5cb7-8b94-4083-b999-24cbae805945 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:59.479014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:59.494237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d15b08ee9347c08eefd23264efde5d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.497709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1069/2177] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:59.498555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5cb7-8b94-4083-b999-24cbae805945 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:59.516972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5cb7-8b94-4083-b999-24cbae805945 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:59.519631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d15b08ee9347c08eefd23264efde5d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.520663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d15b08ee9347c08eefd23264efde5d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.524556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6b893-89bb-46af-85d6-c65fd4ecd36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:59.525867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6b893-89bb-46af-85d6-c65fd4ecd36d admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:59.526353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6b893-89bb-46af-85d6-c65fd4ecd36d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:59.526736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6b893-89bb-46af-85d6-c65fd4ecd36d admin admin] PATH_INFO: `/v3/projects/63e1298908a24a3184ec8116d3832139/users/7f7c719bcb9749888818589232aeea99/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:59.530663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d15b08ee9347c08eefd23264efde5d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.547227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6b893-89bb-46af-85d6-c65fd4ecd36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e1298908a24a3184ec8116d3832139, user_id=7f7c719bcb9749888818589232aeea99, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:59.547489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d15b08ee9347c08eefd23264efde5d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:51:59.550330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6b893-89bb-46af-85d6-c65fd4ecd36d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:59.556961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1109/2178] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:51:59 2022] DELETE /identity/v3/users/30d15b08ee9347c08eefd23264efde5d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:59.570766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1070/2179] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:59 2022] PUT /identity/v3/projects/63e1298908a24a3184ec8116d3832139/users/7f7c719bcb9749888818589232aeea99/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:51:59.575051 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:59.576958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:51:59.695912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b165-c025-4d12-ae6c-90ac2dc2d763 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:59.790459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f41fe9-9a49-485c-a627-3103058a97b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:59.792527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f41fe9-9a49-485c-a627-3103058a97b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:59.793683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f41fe9-9a49-485c-a627-3103058a97b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:59.794231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f41fe9-9a49-485c-a627-3103058a97b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:59.796103 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f41fe9-9a49-485c-a627-3103058a97b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:59.799398 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f41fe9-9a49-485c-a627-3103058a97b2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:59.839235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1110/2180] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:51:59.845432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6b893-89bb-46af-85d6-c65fd4ecd36d admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:51:59.889390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6b893-89bb-46af-85d6-c65fd4ecd36d admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:51:59.923391 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856096cb-164c-464b-b295-f800ba84fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:51:59.928194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856096cb-164c-464b-b295-f800ba84fcdf admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:59.928492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856096cb-164c-464b-b295-f800ba84fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:59.928774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856096cb-164c-464b-b295-f800ba84fcdf admin admin] PATH_INFO: `/v3/projects/63e1298908a24a3184ec8116d3832139/users/7f7c719bcb9749888818589232aeea99/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:51:59.932491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856096cb-164c-464b-b295-f800ba84fcdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e1298908a24a3184ec8116d3832139, user_id=7f7c719bcb9749888818589232aeea99, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:51:59.935316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856096cb-164c-464b-b295-f800ba84fcdf admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:51:59.964396 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1071/2181] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:51:59 2022] PUT /identity/v3/projects/63e1298908a24a3184ec8116d3832139/users/7f7c719bcb9749888818589232aeea99/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:51:59.978520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a22124-d475-4e19-9c91-14e3bfafa3c2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:51:59.979279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a22124-d475-4e19-9c91-14e3bfafa3c2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:51:59.980066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a22124-d475-4e19-9c91-14e3bfafa3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:00.010114 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856096cb-164c-464b-b295-f800ba84fcdf admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:00.012356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-856096cb-164c-464b-b295-f800ba84fcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:00.063654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-40a22124-d475-4e19-9c91-14e3bfafa3c2 None None] MFA Rules not processed for user `7f7c719bcb9749888818589232aeea99`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:00.068233 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-40a22124-d475-4e19-9c91-14e3bfafa3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:00.166954 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:00.171614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856096cb-164c-464b-b295-f800ba84fcdf admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:00.188191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:00.189567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:00.190334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:00.191608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] PATH_INFO: `/v3/projects/8cce34bbd3114e6b920a5813c265147c` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:00.195333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cce34bbd3114e6b920a5813c265147c)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:00.198208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:00.239850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1111/2182] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:51:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:00.245818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a22124-d475-4e19-9c91-14e3bfafa3c2 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:00.247393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-40a22124-d475-4e19-9c91-14e3bfafa3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:00.269039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:00.275087 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cce34bbd3114e6b920a5813c265147c', 'request_id': 'req-e422b807-63ce-4e61-acf9-6f6071034814'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.294913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cce34bbd3114e6b920a5813c265147c', 'request_id': 'req-e422b807-63ce-4e61-acf9-6f6071034814'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.309035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cce34bbd3114e6b920a5813c265147c', 'request_id': 'req-e422b807-63ce-4e61-acf9-6f6071034814'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.324417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] The token cache is being invalidate because project 8cce34bbd3114e6b920a5813c265147c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:00.324858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.326098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.332584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1072/2183] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:00 2022] DELETE /identity/v3/projects/8cce34bbd3114e6b920a5813c265147c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:00.334219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:00.339502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:00.373976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a22124-d475-4e19-9c91-14e3bfafa3c2 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:00.468849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:00.469642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:00.469918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:00.470200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:00.472505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:00.507174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b807-63ce-4e61-acf9-6f6071034814 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:00.516827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:00.517781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:00.519269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:00.519694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] PATH_INFO: `/v3/users/6c98144bc9e641f79bf2f9a00d07e603` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:00.521613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c98144bc9e641f79bf2f9a00d07e603)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:00.524851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:00.590102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:00.591792 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:00.604469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1112/2184] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:00.606515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:00.609105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:00.632497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678fa38-9175-46dd-ad07-713cb02cca7d service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:00.634940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c98144bc9e641f79bf2f9a00d07e603'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.637879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc2ce-e7fa-4e8a-8f3e-ea561ca970e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:00.639028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc2ce-e7fa-4e8a-8f3e-ea561ca970e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:00.639679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc2ce-e7fa-4e8a-8f3e-ea561ca970e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:00.640160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc2ce-e7fa-4e8a-8f3e-ea561ca970e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:00.658335 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-48ffc2ce-e7fa-4e8a-8f3e-ea561ca970e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:00.662756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c98144bc9e641f79bf2f9a00d07e603'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.663607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c98144bc9e641f79bf2f9a00d07e603'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.674492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c98144bc9e641f79bf2f9a00d07e603'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.685263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c98144bc9e641f79bf2f9a00d07e603'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:00.696883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1073/2185] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:00 2022] DELETE /identity/v3/users/6c98144bc9e641f79bf2f9a00d07e603 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:00.761339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:00.781521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc2ce-e7fa-4e8a-8f3e-ea561ca970e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:00.783401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc2ce-e7fa-4e8a-8f3e-ea561ca970e4 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:00.810546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1113/2186] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:01.020205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:01.029413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:01.147338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536bcf4-cc90-4c3e-8bce-e2d8a801ad71 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:01.156914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:01.158134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:01.159228 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:01.159614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:01.162527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:01.176520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:01.221136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc2ce-e7fa-4e8a-8f3e-ea561ca970e4 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:01.252819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc2ce-e7fa-4e8a-8f3e-ea561ca970e4 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:01.377714 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:01.380492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:01.385130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:01.386022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:01.386303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:01.386683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] PATH_INFO: `/v3/projects/7c0d1bef6e0546db8ce6987319e5c5a7` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:01.387970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0d1bef6e0546db8ce6987319e5c5a7)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:01.390078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:01.422111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1074/2187] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:01.470515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0d1bef6e0546db8ce6987319e5c5a7', 'request_id': 'req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:01.485094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0d1bef6e0546db8ce6987319e5c5a7', 'request_id': 'req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:01.497148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0d1bef6e0546db8ce6987319e5c5a7', 'request_id': 'req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:01.521265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] The token cache is being invalidate because project 7c0d1bef6e0546db8ce6987319e5c5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:01.521562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:01.523178 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a24d2e7-e3af-4d4a-99fa-70b3b59eb004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:01.528974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:01.530001 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:01.530705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1114/2188] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:01 2022] DELETE /identity/v3/projects/7c0d1bef6e0546db8ce6987319e5c5a7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:01.537468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6249-52eb-49f9-8b02-9235c5b9b336 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:01.538565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6249-52eb-49f9-8b02-9235c5b9b336 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:01.539393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6249-52eb-49f9-8b02-9235c5b9b336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:01.543525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aff12e-840e-4dbb-8dcf-8b67f55822a7 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:01.584239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-606e6249-52eb-49f9-8b02-9235c5b9b336 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:01.587926 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-606e6249-52eb-49f9-8b02-9235c5b9b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:01.618842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31d051-be18-4685-a67b-6fdfaa70c2a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:01.620299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d051-be18-4685-a67b-6fdfaa70c2a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:01.620299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d051-be18-4685-a67b-6fdfaa70c2a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:01.620299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d051-be18-4685-a67b-6fdfaa70c2a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:01.623417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8e31d051-be18-4685-a67b-6fdfaa70c2a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:01.717124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1115/2189] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:01.725721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2b6bd-ad09-49f2-b6ce-8bc4976a4dd8 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:01.726072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2b6bd-ad09-49f2-b6ce-8bc4976a4dd8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:01.726349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2b6bd-ad09-49f2-b6ce-8bc4976a4dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:01.733721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31d051-be18-4685-a67b-6fdfaa70c2a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:01.735413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31d051-be18-4685-a67b-6fdfaa70c2a1 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:01.751231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1075/2190] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:52:01.772607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-95f2b6bd-ad09-49f2-b6ce-8bc4976a4dd8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:01.774147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-95f2b6bd-ad09-49f2-b6ce-8bc4976a4dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:01.796330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1116/2191] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:01.800422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31d051-be18-4685-a67b-6fdfaa70c2a1 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:01.818032 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31d051-be18-4685-a67b-6fdfaa70c2a1 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:01.825882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a807b-e09b-4fff-89f9-c7a325ad7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:01.827332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a807b-e09b-4fff-89f9-c7a325ad7a52 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:01.828072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a807b-e09b-4fff-89f9-c7a325ad7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:01.828402 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a807b-e09b-4fff-89f9-c7a325ad7a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:01.829548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a807b-e09b-4fff-89f9-c7a325ad7a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:01.830037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a807b-e09b-4fff-89f9-c7a325ad7a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:01.835002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a807b-e09b-4fff-89f9-c7a325ad7a52 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:01.866669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2b6bd-ad09-49f2-b6ce-8bc4976a4dd8 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:01.867367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1076/2192] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:52:01.887122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2b6bd-ad09-49f2-b6ce-8bc4976a4dd8 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:01.909818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298178f-e7cc-4357-80fa-f027f7bd993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:01.912283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298178f-e7cc-4357-80fa-f027f7bd993c admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:01.912738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298178f-e7cc-4357-80fa-f027f7bd993c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:01.914917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298178f-e7cc-4357-80fa-f027f7bd993c admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:01.915787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298178f-e7cc-4357-80fa-f027f7bd993c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:01.923871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298178f-e7cc-4357-80fa-f027f7bd993c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:01.943475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:01.987517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1117/2193] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:01 2022] POST /identity/v3/projects => generated 359 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:52:01.987785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a807b-e09b-4fff-89f9-c7a325ad7a52 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:02.010163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a807b-e09b-4fff-89f9-c7a325ad7a52 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:02.092030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:02.137696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e503686-c1bc-4632-95fb-4040f973126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:02.138756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e503686-c1bc-4632-95fb-4040f973126c admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:02.139038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e503686-c1bc-4632-95fb-4040f973126c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:02.139330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e503686-c1bc-4632-95fb-4040f973126c admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:02.140485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e503686-c1bc-4632-95fb-4040f973126c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:02.143285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e503686-c1bc-4632-95fb-4040f973126c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:02.169107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1077/2194] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:01 2022] POST /identity/v3/users => generated 280 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:02.175656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298178f-e7cc-4357-80fa-f027f7bd993c admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:02.190061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298178f-e7cc-4357-80fa-f027f7bd993c admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:02.198928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefe401-f2bb-400f-bde5-5a62350ae7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:02.200287 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefe401-f2bb-400f-bde5-5a62350ae7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:02.200814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefe401-f2bb-400f-bde5-5a62350ae7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:02.201324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefe401-f2bb-400f-bde5-5a62350ae7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:02.202915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefe401-f2bb-400f-bde5-5a62350ae7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:02.206545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefe401-f2bb-400f-bde5-5a62350ae7d3 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:02.230122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1118/2195] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:02.236037 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e503686-c1bc-4632-95fb-4040f973126c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:02.253180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e503686-c1bc-4632-95fb-4040f973126c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:02.260385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969268-9d5e-4db8-9982-eba5a493ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:02.261099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969268-9d5e-4db8-9982-eba5a493ff4a admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:02.261392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969268-9d5e-4db8-9982-eba5a493ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:02.261674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969268-9d5e-4db8-9982-eba5a493ff4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:02.262513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969268-9d5e-4db8-9982-eba5a493ff4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:02.265080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969268-9d5e-4db8-9982-eba5a493ff4a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:02.281880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1078/2196] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:02.299318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefe401-f2bb-400f-bde5-5a62350ae7d3 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:02.322346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefe401-f2bb-400f-bde5-5a62350ae7d3 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:02.331075 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2df80-7f47-4fe9-a9d0-fce755bf61e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:02.332669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2df80-7f47-4fe9-a9d0-fce755bf61e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:02.332973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2df80-7f47-4fe9-a9d0-fce755bf61e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:02.333281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2df80-7f47-4fe9-a9d0-fce755bf61e4 admin admin] PATH_INFO: `/v3/projects/b325b8a8d05a462eb3493e4c01195cbc/users/06fd89a295bb43d8b9e72fb9d7005010/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:02.352994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2df80-7f47-4fe9-a9d0-fce755bf61e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b325b8a8d05a462eb3493e4c01195cbc, user_id=06fd89a295bb43d8b9e72fb9d7005010, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:02.355893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2df80-7f47-4fe9-a9d0-fce755bf61e4 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:02.375014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1119/2197] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:02 2022] PUT /identity/v3/projects/b325b8a8d05a462eb3493e4c01195cbc/users/06fd89a295bb43d8b9e72fb9d7005010/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:02.387675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c423c5-cffb-4618-aa1b-bb817106b86a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:02.387979 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c423c5-cffb-4618-aa1b-bb817106b86a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:02.388222 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c423c5-cffb-4618-aa1b-bb817106b86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:02.420712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-28c423c5-cffb-4618-aa1b-bb817106b86a None None] MFA Rules not processed for user `06fd89a295bb43d8b9e72fb9d7005010`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:02.422100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-28c423c5-cffb-4618-aa1b-bb817106b86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:02.524824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1079/2198] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:02 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:02.566117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2df80-7f47-4fe9-a9d0-fce755bf61e4 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:02.568622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-aae2df80-7f47-4fe9-a9d0-fce755bf61e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:02.653315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2df80-7f47-4fe9-a9d0-fce755bf61e4 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:02.657413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a1bba-3cfb-42bc-bb6e-7fee919e5566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:02.658088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1bba-3cfb-42bc-bb6e-7fee919e5566 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:02.658375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1bba-3cfb-42bc-bb6e-7fee919e5566 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:02.658679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1bba-3cfb-42bc-bb6e-7fee919e5566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:02.669796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a1bba-3cfb-42bc-bb6e-7fee919e5566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:02.671731 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a1bba-3cfb-42bc-bb6e-7fee919e5566 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:02.683768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1120/2199] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:02 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:02.700273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c423c5-cffb-4618-aa1b-bb817106b86a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:02.809233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c423c5-cffb-4618-aa1b-bb817106b86a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:02.817519 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:02.819149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:02.819694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:02.820220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] PATH_INFO: `/v3/users/06fd89a295bb43d8b9e72fb9d7005010` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:02.822668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fd89a295bb43d8b9e72fb9d7005010)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:02.826572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:02.915935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fd89a295bb43d8b9e72fb9d7005010'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:02.924522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:02.946920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fd89a295bb43d8b9e72fb9d7005010'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:02.947882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fd89a295bb43d8b9e72fb9d7005010'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:02.957756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fd89a295bb43d8b9e72fb9d7005010'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:02.977917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fd89a295bb43d8b9e72fb9d7005010'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:02.985321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1080/2200] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:02 2022] DELETE /identity/v3/users/06fd89a295bb43d8b9e72fb9d7005010 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:02.990980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c862-c634-4f87-9b02-73cee8e17227 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:02.992188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c862-c634-4f87-9b02-73cee8e17227 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:02.993223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c862-c634-4f87-9b02-73cee8e17227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:03.027169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b182c862-c634-4f87-9b02-73cee8e17227 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:03.029315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b182c862-c634-4f87-9b02-73cee8e17227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:03.158986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1121/2201] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:03.173192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:03.174780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:03.300255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c1d52-356a-4a8f-9ad0-d1e6189fb6ca admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:03.311626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550105a-a59f-45b2-95dd-b073eea68381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:03.312863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550105a-a59f-45b2-95dd-b073eea68381 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:03.314418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550105a-a59f-45b2-95dd-b073eea68381 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:03.314804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550105a-a59f-45b2-95dd-b073eea68381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:03.337240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550105a-a59f-45b2-95dd-b073eea68381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:03.340732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550105a-a59f-45b2-95dd-b073eea68381 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:03.364770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1081/2202] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:03.814940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c862-c634-4f87-9b02-73cee8e17227 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:03.817431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b182c862-c634-4f87-9b02-73cee8e17227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:03.838965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c862-c634-4f87-9b02-73cee8e17227 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:03.846991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:03.848485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:03.848720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:03.849044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] PATH_INFO: `/v3/projects/b325b8a8d05a462eb3493e4c01195cbc` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:03.851512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b325b8a8d05a462eb3493e4c01195cbc)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:03.854332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:03.945054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b325b8a8d05a462eb3493e4c01195cbc', 'request_id': 'req-5e785e27-73ca-42cd-84ea-0181e668ca51'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:03.948878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:03.954178 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b325b8a8d05a462eb3493e4c01195cbc', 'request_id': 'req-5e785e27-73ca-42cd-84ea-0181e668ca51'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:03.964702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b325b8a8d05a462eb3493e4c01195cbc', 'request_id': 'req-5e785e27-73ca-42cd-84ea-0181e668ca51'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:03.977875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] The token cache is being invalidate because project b325b8a8d05a462eb3493e4c01195cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:03.978178 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:03.978858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5e785e27-73ca-42cd-84ea-0181e668ca51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:03.980591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1122/2203] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:03 2022] DELETE /identity/v3/projects/b325b8a8d05a462eb3493e4c01195cbc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:03.988514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddfbae-6b7c-4360-baaa-a002d64674f0 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:03.989077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddfbae-6b7c-4360-baaa-a002d64674f0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:03.989762 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddfbae-6b7c-4360-baaa-a002d64674f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:04.014073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c4ddfbae-6b7c-4360-baaa-a002d64674f0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:04.015737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c4ddfbae-6b7c-4360-baaa-a002d64674f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:04.108592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1082/2204] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:04.117306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055346a8-1b8c-43d6-99b6-4027490b5203 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:04.117579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055346a8-1b8c-43d6-99b6-4027490b5203 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:04.117870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055346a8-1b8c-43d6-99b6-4027490b5203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:04.140623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-055346a8-1b8c-43d6-99b6-4027490b5203 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:04.141862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-055346a8-1b8c-43d6-99b6-4027490b5203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:04.151933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1123/2205] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:04.157373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddfbae-6b7c-4360-baaa-a002d64674f0 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:04.171132 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddfbae-6b7c-4360-baaa-a002d64674f0 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:04.177162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4b863-4b41-47e0-b215-b6e2b0ae36e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:04.177991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4b863-4b41-47e0-b215-b6e2b0ae36e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:04.178135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4b863-4b41-47e0-b215-b6e2b0ae36e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:04.178417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4b863-4b41-47e0-b215-b6e2b0ae36e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:04.179755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4b863-4b41-47e0-b215-b6e2b0ae36e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:04.180090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4b863-4b41-47e0-b215-b6e2b0ae36e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:04.181777 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4b863-4b41-47e0-b215-b6e2b0ae36e9 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:04.195758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1083/2206] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:52:04.200522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055346a8-1b8c-43d6-99b6-4027490b5203 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:04.211899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055346a8-1b8c-43d6-99b6-4027490b5203 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:04.217119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ba6dc-0216-4331-bdc6-226ea61a5463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:04.217958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ba6dc-0216-4331-bdc6-226ea61a5463 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:04.218244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ba6dc-0216-4331-bdc6-226ea61a5463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:04.218564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ba6dc-0216-4331-bdc6-226ea61a5463 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:04.219271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ba6dc-0216-4331-bdc6-226ea61a5463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:04.221231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ba6dc-0216-4331-bdc6-226ea61a5463 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:04.267588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1124/2207] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:04 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:04.268736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4b863-4b41-47e0-b215-b6e2b0ae36e9 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:04.280276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4b863-4b41-47e0-b215-b6e2b0ae36e9 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:04.374235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3388-d974-4752-9aa1-3bbfeb87eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:04.375078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3388-d974-4752-9aa1-3bbfeb87eb16 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:04.375454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3388-d974-4752-9aa1-3bbfeb87eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:04.375894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3388-d974-4752-9aa1-3bbfeb87eb16 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:04.376658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3388-d974-4752-9aa1-3bbfeb87eb16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:04.379196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3388-d974-4752-9aa1-3bbfeb87eb16 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:04.389820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:04.417346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1084/2208] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:04 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:52:04.424028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ba6dc-0216-4331-bdc6-226ea61a5463 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:04.439170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ba6dc-0216-4331-bdc6-226ea61a5463 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:04.446460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aa467-be32-46c4-9777-e511c804a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:04.447197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aa467-be32-46c4-9777-e511c804a456 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:04.447542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aa467-be32-46c4-9777-e511c804a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:04.447821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aa467-be32-46c4-9777-e511c804a456 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:04.448568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399aa467-be32-46c4-9777-e511c804a456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:04.450455 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399aa467-be32-46c4-9777-e511c804a456 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:04.466914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1125/2209] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:04.473916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3388-d974-4752-9aa1-3bbfeb87eb16 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:04.501525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3388-d974-4752-9aa1-3bbfeb87eb16 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:04.511989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b341a6-4ae9-483f-8eff-29ceee6a6a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:04.513161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b341a6-4ae9-483f-8eff-29ceee6a6a8f admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:04.513738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b341a6-4ae9-483f-8eff-29ceee6a6a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:04.514216 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b341a6-4ae9-483f-8eff-29ceee6a6a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:04.515716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b341a6-4ae9-483f-8eff-29ceee6a6a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:04.518688 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b341a6-4ae9-483f-8eff-29ceee6a6a8f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:04.546547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1085/2210] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:04.549148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aa467-be32-46c4-9777-e511c804a456 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:04.573869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aa467-be32-46c4-9777-e511c804a456 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:04.583058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d20dce-c778-433d-9f24-bc9c0b02e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:04.584606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d20dce-c778-433d-9f24-bc9c0b02e493 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:04.585591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d20dce-c778-433d-9f24-bc9c0b02e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:04.586156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d20dce-c778-433d-9f24-bc9c0b02e493 admin admin] PATH_INFO: `/v3/projects/41ed3093e88140089ea2147c3abbffd0/users/aaba7a0e93724090bc7379031bb7c720/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:04.637029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d20dce-c778-433d-9f24-bc9c0b02e493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ed3093e88140089ea2147c3abbffd0, user_id=aaba7a0e93724090bc7379031bb7c720, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:04.642318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d20dce-c778-433d-9f24-bc9c0b02e493 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:04.699320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1126/2211] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:04 2022] PUT /identity/v3/projects/41ed3093e88140089ea2147c3abbffd0/users/aaba7a0e93724090bc7379031bb7c720/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:04.708315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022d37-5010-4803-81c6-3ded581ab147 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:04.709616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022d37-5010-4803-81c6-3ded581ab147 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:04.710603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022d37-5010-4803-81c6-3ded581ab147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:04.798254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-9a022d37-5010-4803-81c6-3ded581ab147 None None] MFA Rules not processed for user `aaba7a0e93724090bc7379031bb7c720`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:04.803051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-9a022d37-5010-4803-81c6-3ded581ab147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:04.931959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1086/2212] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:04.932872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d20dce-c778-433d-9f24-bc9c0b02e493 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:05.049153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d20dce-c778-433d-9f24-bc9c0b02e493 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:05.063970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f5c5-a5ee-45d6-9897-000947d2b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:05.064749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f5c5-a5ee-45d6-9897-000947d2b510 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.065124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f5c5-a5ee-45d6-9897-000947d2b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.065459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f5c5-a5ee-45d6-9897-000947d2b510 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.066550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9f5c5-a5ee-45d6-9897-000947d2b510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:05.069375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9f5c5-a5ee-45d6-9897-000947d2b510 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:05.114432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1127/2213] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:04 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:52:05.117044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022d37-5010-4803-81c6-3ded581ab147 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:05.134629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022d37-5010-4803-81c6-3ded581ab147 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:05.239078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad2bfc-c482-4468-beb7-fc33a8056278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:05.239864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad2bfc-c482-4468-beb7-fc33a8056278 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.240562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad2bfc-c482-4468-beb7-fc33a8056278 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.240857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad2bfc-c482-4468-beb7-fc33a8056278 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.246902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad2bfc-c482-4468-beb7-fc33a8056278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:05.246902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad2bfc-c482-4468-beb7-fc33a8056278 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:05.272369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1087/2214] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:05 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:05.278159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f5c5-a5ee-45d6-9897-000947d2b510 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:05.287392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad2bfc-c482-4468-beb7-fc33a8056278 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:05.291699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-73ad2bfc-c482-4468-beb7-fc33a8056278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:05.302288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f5c5-a5ee-45d6-9897-000947d2b510 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:05.309954 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc32bbc-33fd-42ee-af60-f01b3dcd3fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:05.311252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32bbc-33fd-42ee-af60-f01b3dcd3fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.311252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32bbc-33fd-42ee-af60-f01b3dcd3fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.311494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc32bbc-33fd-42ee-af60-f01b3dcd3fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.312494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc32bbc-33fd-42ee-af60-f01b3dcd3fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:05.314538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc32bbc-33fd-42ee-af60-f01b3dcd3fe8 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:05.318636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad2bfc-c482-4468-beb7-fc33a8056278 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:05.332920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1128/2215] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:52:05.333921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc32bbc-33fd-42ee-af60-f01b3dcd3fe8 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:05.334130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:05.345139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.345139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.345139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] PATH_INFO: `/v3/users/5fa0f39619154ff5973cfc7cb21b8553` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.345139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa0f39619154ff5973cfc7cb21b8553)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:05.345684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:05.352927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc32bbc-33fd-42ee-af60-f01b3dcd3fe8 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:05.358360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38241e25-4289-461a-b614-031a13f9c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:05.359637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38241e25-4289-461a-b614-031a13f9c62a admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.359980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38241e25-4289-461a-b614-031a13f9c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.360286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38241e25-4289-461a-b614-031a13f9c62a admin admin] PATH_INFO: `/v3/projects/1380dbc642cd44468de98420c664a3be/users/a6e85a903e114bc18bf8f336b34d9e39/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.382250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38241e25-4289-461a-b614-031a13f9c62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1380dbc642cd44468de98420c664a3be, user_id=a6e85a903e114bc18bf8f336b34d9e39, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:05.385337 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38241e25-4289-461a-b614-031a13f9c62a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:05.405531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1129/2216] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:05 2022] PUT /identity/v3/projects/1380dbc642cd44468de98420c664a3be/users/a6e85a903e114bc18bf8f336b34d9e39/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:05.406757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38241e25-4289-461a-b614-031a13f9c62a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:05.419040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa0f39619154ff5973cfc7cb21b8553'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:05.424766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:05.440109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa0f39619154ff5973cfc7cb21b8553'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:05.442520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa0f39619154ff5973cfc7cb21b8553'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:05.451471 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:05.452781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa0f39619154ff5973cfc7cb21b8553'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:05.470131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7407ebdb-095a-413d-bb53-6a548ae14dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa0f39619154ff5973cfc7cb21b8553'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:05.478860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1088/2217] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:05 2022] DELETE /identity/v3/users/5fa0f39619154ff5973cfc7cb21b8553 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:05.484390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc9af-24b7-4409-96e5-a5748fac5703 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.484765 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc9af-24b7-4409-96e5-a5748fac5703 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.485047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc9af-24b7-4409-96e5-a5748fac5703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.507315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e3bbc9af-24b7-4409-96e5-a5748fac5703 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:05.509115 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e3bbc9af-24b7-4409-96e5-a5748fac5703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:05.517674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38241e25-4289-461a-b614-031a13f9c62a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:05.594131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace9345-0923-487e-b43c-04518c56c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:05.594834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace9345-0923-487e-b43c-04518c56c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.595199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace9345-0923-487e-b43c-04518c56c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.595632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace9345-0923-487e-b43c-04518c56c4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.596383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace9345-0923-487e-b43c-04518c56c4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:05.598002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace9345-0923-487e-b43c-04518c56c4fe admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:05.602715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1089/2218] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:05.610680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1130/2219] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:05.613774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbc9af-24b7-4409-96e5-a5748fac5703 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:05.615005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace9345-0923-487e-b43c-04518c56c4fe admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:05.618713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e3bbc9af-24b7-4409-96e5-a5748fac5703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:05.619385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dace9345-0923-487e-b43c-04518c56c4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:05.636592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace9345-0923-487e-b43c-04518c56c4fe admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:05.644109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d0d0a-8020-4cd7-9deb-5309e5546042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:05.645940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d0d0a-8020-4cd7-9deb-5309e5546042 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.646244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d0d0a-8020-4cd7-9deb-5309e5546042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.646568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d0d0a-8020-4cd7-9deb-5309e5546042 admin admin] PATH_INFO: `/v3/projects/1380dbc642cd44468de98420c664a3be/users/a6e85a903e114bc18bf8f336b34d9e39/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.649309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d0d0a-8020-4cd7-9deb-5309e5546042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1380dbc642cd44468de98420c664a3be, user_id=a6e85a903e114bc18bf8f336b34d9e39, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:05.654661 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d0d0a-8020-4cd7-9deb-5309e5546042 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:05.667741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1131/2220] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:05 2022] PUT /identity/v3/projects/1380dbc642cd44468de98420c664a3be/users/a6e85a903e114bc18bf8f336b34d9e39/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:05.679950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8143f9b-47f1-41db-b726-ff4a4fb801ac None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.680245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8143f9b-47f1-41db-b726-ff4a4fb801ac None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.680591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8143f9b-47f1-41db-b726-ff4a4fb801ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.717275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbc9af-24b7-4409-96e5-a5748fac5703 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:05.721001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-f8143f9b-47f1-41db-b726-ff4a4fb801ac None None] MFA Rules not processed for user `a6e85a903e114bc18bf8f336b34d9e39`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:05.722681 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f8143f9b-47f1-41db-b726-ff4a4fb801ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:05.785540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909e1d1-3f25-4226-9ac9-d95816463e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:05.786055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909e1d1-3f25-4226-9ac9-d95816463e4e service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.786333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909e1d1-3f25-4226-9ac9-d95816463e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.786648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909e1d1-3f25-4226-9ac9-d95816463e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.849871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:05.853130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1132/2221] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:05.868925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8143f9b-47f1-41db-b726-ff4a4fb801ac None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:05.871018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f8143f9b-47f1-41db-b726-ff4a4fb801ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:05.889142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909e1d1-3f25-4226-9ac9-d95816463e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:05.891359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909e1d1-3f25-4226-9ac9-d95816463e4e service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:05.909224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1090/2222] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:05.941583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:05.961935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8143f9b-47f1-41db-b726-ff4a4fb801ac None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:05.968278 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:05.970565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:05.970938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:05.971292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:05.976322 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:06.154145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:06.157302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:06.185782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1133/2223] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:52:06.385687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909e1d1-3f25-4226-9ac9-d95816463e4e service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:06.393275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7909e1d1-3f25-4226-9ac9-d95816463e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:06.423784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909e1d1-3f25-4226-9ac9-d95816463e4e service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:06.439220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:06.440682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:06.441209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:06.441639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] PATH_INFO: `/v3/projects/9f2b37eb6dfc45ff8b2044398555799e` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:06.445050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2b37eb6dfc45ff8b2044398555799e)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:06.449203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:06.488222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:06.490438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:06.514260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093c529-f623-461f-bcda-19a49750e4fe service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:06.551261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2b37eb6dfc45ff8b2044398555799e', 'request_id': 'req-763fbd19-127d-4ea5-8627-9a692ad7eff1'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.563823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2b37eb6dfc45ff8b2044398555799e', 'request_id': 'req-763fbd19-127d-4ea5-8627-9a692ad7eff1'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.581624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2b37eb6dfc45ff8b2044398555799e', 'request_id': 'req-763fbd19-127d-4ea5-8627-9a692ad7eff1'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.603591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] The token cache is being invalidate because project 9f2b37eb6dfc45ff8b2044398555799e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:06.603591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.604829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-763fbd19-127d-4ea5-8627-9a692ad7eff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.607684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1091/2224] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:06 2022] DELETE /identity/v3/projects/9f2b37eb6dfc45ff8b2044398555799e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:06.615141 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438079d-9a13-4446-b458-4b4424a64b41 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:06.615522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438079d-9a13-4446-b458-4b4424a64b41 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:06.617192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438079d-9a13-4446-b458-4b4424a64b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:06.628515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:06.630076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:06.630448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:06.630773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] PATH_INFO: `/v3/users/d6227330f04a42f5b55040d72138cf5a` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:06.633361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6227330f04a42f5b55040d72138cf5a)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:06.637091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:06.642059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-9438079d-9a13-4446-b458-4b4424a64b41 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:06.643862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-9438079d-9a13-4446-b458-4b4424a64b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:06.667273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1092/2225] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:06.676875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d579809-fe47-4eb7-bce9-b2989f3f3488 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:06.677283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d579809-fe47-4eb7-bce9-b2989f3f3488 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:06.677671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d579809-fe47-4eb7-bce9-b2989f3f3488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:06.709988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-1d579809-fe47-4eb7-bce9-b2989f3f3488 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:06.712681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1d579809-fe47-4eb7-bce9-b2989f3f3488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:06.721842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6227330f04a42f5b55040d72138cf5a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.727699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1093/2226] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:06.734262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d579809-fe47-4eb7-bce9-b2989f3f3488 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:06.748846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d579809-fe47-4eb7-bce9-b2989f3f3488 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:06.749100 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6227330f04a42f5b55040d72138cf5a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.750530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6227330f04a42f5b55040d72138cf5a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.756268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:06.758321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:06.758636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:06.758938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:06.760164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:06.760425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:06.762672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:06.771819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6227330f04a42f5b55040d72138cf5a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.783261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6623d5f7-573a-4e14-90d0-d527810cb323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6227330f04a42f5b55040d72138cf5a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:06.789786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1094/2227] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:52:06.790879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:06.792378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1134/2228] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:06 2022] DELETE /identity/v3/users/d6227330f04a42f5b55040d72138cf5a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:06.792843 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:06.797766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce810-a78b-4718-9119-5813cd9d70cd None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:06.798241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce810-a78b-4718-9119-5813cd9d70cd None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:06.798880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce810-a78b-4718-9119-5813cd9d70cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:06.809871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70d1e3-e14b-4df0-b68b-7e83afabbf0c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:06.825576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-0f2ce810-a78b-4718-9119-5813cd9d70cd None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:06.826846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0f2ce810-a78b-4718-9119-5813cd9d70cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:06.838205 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:06.887656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabefbf9-dc29-4725-83cf-d20cba639ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:06.888719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabefbf9-dc29-4725-83cf-d20cba639ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:06.889232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabefbf9-dc29-4725-83cf-d20cba639ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:06.889741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabefbf9-dc29-4725-83cf-d20cba639ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:06.890956 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabefbf9-dc29-4725-83cf-d20cba639ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:06.894509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabefbf9-dc29-4725-83cf-d20cba639ed8 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:06.897971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1135/2229] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:06.907658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ce810-a78b-4718-9119-5813cd9d70cd None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:06.909161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0f2ce810-a78b-4718-9119-5813cd9d70cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:06.949119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1095/2230] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:06 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:06.950650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabefbf9-dc29-4725-83cf-d20cba639ed8 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:06.982155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ce810-a78b-4718-9119-5813cd9d70cd None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:06.983662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:07.043933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabefbf9-dc29-4725-83cf-d20cba639ed8 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:07.049928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137a26-4845-4df9-a182-6397e07109d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:07.050611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32253e7c-421a-4aa9-a1d7-3e16e9bb8e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:07.050837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a26-4845-4df9-a182-6397e07109d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:07.050986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a26-4845-4df9-a182-6397e07109d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:07.051386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137a26-4845-4df9-a182-6397e07109d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:07.051949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32253e7c-421a-4aa9-a1d7-3e16e9bb8e80 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:07.052442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32253e7c-421a-4aa9-a1d7-3e16e9bb8e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:07.052791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32253e7c-421a-4aa9-a1d7-3e16e9bb8e80 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:07.054409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32253e7c-421a-4aa9-a1d7-3e16e9bb8e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:07.056534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32253e7c-421a-4aa9-a1d7-3e16e9bb8e80 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:07.064523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137a26-4845-4df9-a182-6397e07109d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:07.066273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137a26-4845-4df9-a182-6397e07109d7 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:07.086911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1096/2231] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:06 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:07.087223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1136/2232] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:52:07.088133 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32253e7c-421a-4aa9-a1d7-3e16e9bb8e80 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:07.104814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32253e7c-421a-4aa9-a1d7-3e16e9bb8e80 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:07.110210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002451-58c6-4992-9147-1bc3249ef709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:07.111284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002451-58c6-4992-9147-1bc3249ef709 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:07.111465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002451-58c6-4992-9147-1bc3249ef709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:07.111634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002451-58c6-4992-9147-1bc3249ef709 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:07.112741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002451-58c6-4992-9147-1bc3249ef709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:07.113989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002451-58c6-4992-9147-1bc3249ef709 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:07.134454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1097/2233] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:07.136624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137a26-4845-4df9-a182-6397e07109d7 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:07.151416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137a26-4845-4df9-a182-6397e07109d7 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:07.157624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7b2e1-9c14-4cc0-b785-80999422ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:07.158623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b2e1-9c14-4cc0-b785-80999422ccda admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:07.158921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b2e1-9c14-4cc0-b785-80999422ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:07.159361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7b2e1-9c14-4cc0-b785-80999422ccda admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:07.160134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7b2e1-9c14-4cc0-b785-80999422ccda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:07.161937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7b2e1-9c14-4cc0-b785-80999422ccda admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:07.186670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1137/2234] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:07.191236 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002451-58c6-4992-9147-1bc3249ef709 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:07.204293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002451-58c6-4992-9147-1bc3249ef709 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:07.212950 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9886-b515-467f-a385-fdb6b64dbc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:07.214599 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9886-b515-467f-a385-fdb6b64dbc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:07.215216 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9886-b515-467f-a385-fdb6b64dbc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:07.215831 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9886-b515-467f-a385-fdb6b64dbc21 admin admin] PATH_INFO: `/v3/projects/abb30e4238e541efb915fc827e543711/users/740af3545c4b45208d80fa38132b30d6/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:07.247099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b9886-b515-467f-a385-fdb6b64dbc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb30e4238e541efb915fc827e543711, user_id=740af3545c4b45208d80fa38132b30d6, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:07.252594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b9886-b515-467f-a385-fdb6b64dbc21 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:07.302175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1098/2235] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:07 2022] PUT /identity/v3/projects/abb30e4238e541efb915fc827e543711/users/740af3545c4b45208d80fa38132b30d6/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:07.322758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a178f-1116-4bf4-8a42-3470ca60ce72 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:07.323193 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a178f-1116-4bf4-8a42-3470ca60ce72 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:07.323849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a178f-1116-4bf4-8a42-3470ca60ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:07.366764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-2b0a178f-1116-4bf4-8a42-3470ca60ce72 None None] MFA Rules not processed for user `740af3545c4b45208d80fa38132b30d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:07.368272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2b0a178f-1116-4bf4-8a42-3470ca60ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:07.501949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9886-b515-467f-a385-fdb6b64dbc21 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:07.505554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-cf8b9886-b515-467f-a385-fdb6b64dbc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:07.562610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:07.590422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1138/2236] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:07.612879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a178f-1116-4bf4-8a42-3470ca60ce72 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:07.616664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2b0a178f-1116-4bf4-8a42-3470ca60ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:07.673366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9886-b515-467f-a385-fdb6b64dbc21 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:07.681781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:07.683040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:07.683482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:07.683916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] PATH_INFO: `/v3/projects/73b960c678f3478aaaa185b071089be1` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:07.686025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b960c678f3478aaaa185b071089be1)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:07.689092 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:07.753444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a178f-1116-4bf4-8a42-3470ca60ce72 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:07.775205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b960c678f3478aaaa185b071089be1', 'request_id': 'req-2adc48dc-61d7-499e-a9cc-bad081720020'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:07.790330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b960c678f3478aaaa185b071089be1', 'request_id': 'req-2adc48dc-61d7-499e-a9cc-bad081720020'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:07.807012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b960c678f3478aaaa185b071089be1', 'request_id': 'req-2adc48dc-61d7-499e-a9cc-bad081720020'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:07.828903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] The token cache is being invalidate because project 73b960c678f3478aaaa185b071089be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:07.828903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:07.829867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:07.835295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1099/2237] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:07 2022] DELETE /identity/v3/projects/73b960c678f3478aaaa185b071089be1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:07.839479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:07.844474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:07.852765 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:07.868730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:07.869496 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:07.869786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:07.870462 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:07.901394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:07.942516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc48dc-61d7-499e-a9cc-bad081720020 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:07.948320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:07.949416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:07.950700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:07.950700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] PATH_INFO: `/v3/users/5074e965dd12490ab2d133637da99e24` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:07.951943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5074e965dd12490ab2d133637da99e24)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:07.953957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:08.035640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:08.037405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:08.045942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5074e965dd12490ab2d133637da99e24'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.052509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1139/2238] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:08.052509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:08.052509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:08.075739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5074e965dd12490ab2d133637da99e24'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.076949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5074e965dd12490ab2d133637da99e24'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.090129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5074e965dd12490ab2d133637da99e24'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.102797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b648f5-880e-451a-bff9-27c2d2d5bc12 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:08.106699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6692c5ce-9582-4173-9609-f0b3c5046f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5074e965dd12490ab2d133637da99e24'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.120313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:08.121740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1100/2239] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:07 2022] DELETE /identity/v3/users/5074e965dd12490ab2d133637da99e24 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:08.122266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:08.122975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:08.123401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] PATH_INFO: `/v3/users/8d09c90ac3424927b641ede8fc15af4a` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:08.125112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d09c90ac3424927b641ede8fc15af4a)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:08.127430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a7808-4f81-4515-b860-ab2fb7bdc096 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:08.127677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:08.127882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a7808-4f81-4515-b860-ab2fb7bdc096 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:08.128239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a7808-4f81-4515-b860-ab2fb7bdc096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:08.187613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-541a7808-4f81-4515-b860-ab2fb7bdc096 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:08.190584 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-541a7808-4f81-4515-b860-ab2fb7bdc096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:08.246014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d09c90ac3424927b641ede8fc15af4a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.267011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:08.279876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d09c90ac3424927b641ede8fc15af4a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.280870 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d09c90ac3424927b641ede8fc15af4a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.286318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1101/2240] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:08.294076 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d09c90ac3424927b641ede8fc15af4a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.305110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a7808-4f81-4515-b860-ab2fb7bdc096 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:08.307297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-541a7808-4f81-4515-b860-ab2fb7bdc096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:08.314294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d09c90ac3424927b641ede8fc15af4a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:08.326639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1140/2241] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:08 2022] DELETE /identity/v3/users/8d09c90ac3424927b641ede8fc15af4a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:08.360101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:08.423193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a7808-4f81-4515-b860-ab2fb7bdc096 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:08.533748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba85be-6e91-4006-91e4-ba4f6a635894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:08.534838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba85be-6e91-4006-91e4-ba4f6a635894 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:08.535209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba85be-6e91-4006-91e4-ba4f6a635894 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:08.535746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba85be-6e91-4006-91e4-ba4f6a635894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:08.539455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-62ba85be-6e91-4006-91e4-ba4f6a635894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:08.639138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba85be-6e91-4006-91e4-ba4f6a635894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:08.640813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba85be-6e91-4006-91e4-ba4f6a635894 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:08.651905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1102/2242] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:08.907575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:08.910630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:08.933711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c44b4-ded7-4012-b5f1-a66877e0154f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:08.943919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:08.946223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:08.946684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:08.947260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] PATH_INFO: `/v3/projects/5c4e37c1d445418b9daa07a6ff14af3b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:08.951160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4e37c1d445418b9daa07a6ff14af3b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:08.953555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:09.041507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4e37c1d445418b9daa07a6ff14af3b', 'request_id': 'req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.049048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4e37c1d445418b9daa07a6ff14af3b', 'request_id': 'req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.058673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4e37c1d445418b9daa07a6ff14af3b', 'request_id': 'req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.074354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] The token cache is being invalidate because project 5c4e37c1d445418b9daa07a6ff14af3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:09.075291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.076052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.078050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1141/2243] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:08 2022] DELETE /identity/v3/projects/5c4e37c1d445418b9daa07a6ff14af3b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:09.082756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba85be-6e91-4006-91e4-ba4f6a635894 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:09.094852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba85be-6e91-4006-91e4-ba4f6a635894 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:09.179589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:09.180436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:09.181233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:09.181233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] PATH_INFO: `/v3/users/fcd99ce93ccf4665bdfa1952c04c1abd` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:09.185445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:09.185874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd99ce93ccf4665bdfa1952c04c1abd)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:09.189505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:09.189708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:09.210449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54b33c-7b6e-49c6-8674-9f2c477c0f87 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:09.216009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:09.216914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:09.217198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:09.217473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] PATH_INFO: `/v3/users/aaba7a0e93724090bc7379031bb7c720` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:09.219699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaba7a0e93724090bc7379031bb7c720)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:09.222701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:09.248627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:09.280790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd99ce93ccf4665bdfa1952c04c1abd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.311988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd99ce93ccf4665bdfa1952c04c1abd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.316048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd99ce93ccf4665bdfa1952c04c1abd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.326657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd99ce93ccf4665bdfa1952c04c1abd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.327260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaba7a0e93724090bc7379031bb7c720'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.337040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd99ce93ccf4665bdfa1952c04c1abd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.343930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaba7a0e93724090bc7379031bb7c720'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.344718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaba7a0e93724090bc7379031bb7c720'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.353670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaba7a0e93724090bc7379031bb7c720'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.354466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1103/2244] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:09 2022] DELETE /identity/v3/users/fcd99ce93ccf4665bdfa1952c04c1abd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:09.355935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:09.359175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:09.366880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-198f9ba9-296c-4b73-9011-9c7477272870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaba7a0e93724090bc7379031bb7c720'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.377754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1142/2245] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:09 2022] DELETE /identity/v3/users/aaba7a0e93724090bc7379031bb7c720 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:09.383448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd36e-4a9c-4782-9854-7f0af8ff7af5 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:09.384328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd36e-4a9c-4782-9854-7f0af8ff7af5 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:09.384623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd36e-4a9c-4782-9854-7f0af8ff7af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:09.409676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-8ffdd36e-4a9c-4782-9854-7f0af8ff7af5 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:09.410996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8ffdd36e-4a9c-4782-9854-7f0af8ff7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:09.452642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:09.506623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37009a43-036e-44f8-b067-994ce62b0ecf admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:09.530804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1143/2246] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:09.556678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd36e-4a9c-4782-9854-7f0af8ff7af5 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:09.562186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8ffdd36e-4a9c-4782-9854-7f0af8ff7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:09.593756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:09.594718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:09.595005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:09.595288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] PATH_INFO: `/v3/projects/7b08199b012e4add8dbe5a3cac2f99e8` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:09.596855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b08199b012e4add8dbe5a3cac2f99e8)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:09.599109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:09.669610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd36e-4a9c-4782-9854-7f0af8ff7af5 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:09.693048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b08199b012e4add8dbe5a3cac2f99e8', 'request_id': 'req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.716098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b08199b012e4add8dbe5a3cac2f99e8', 'request_id': 'req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.718581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:09.735642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b08199b012e4add8dbe5a3cac2f99e8', 'request_id': 'req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.737470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495b315-7540-4898-9709-e9cc24679300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:09.738204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495b315-7540-4898-9709-e9cc24679300 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:09.738546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495b315-7540-4898-9709-e9cc24679300 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:09.739005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495b315-7540-4898-9709-e9cc24679300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:09.761816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] The token cache is being invalidate because project 7b08199b012e4add8dbe5a3cac2f99e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:09.762514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.764035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:09.768628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1104/2247] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:09 2022] DELETE /identity/v3/projects/7b08199b012e4add8dbe5a3cac2f99e8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:09.775054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:09.777655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:09.876269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495b315-7540-4898-9709-e9cc24679300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:09.878208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495b315-7540-4898-9709-e9cc24679300 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:09.910889 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1144/2248] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:09.923565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495b315-7540-4898-9709-e9cc24679300 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:09.925663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0495b315-7540-4898-9709-e9cc24679300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:09.940502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495b315-7540-4898-9709-e9cc24679300 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:09.943422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e0d7e-bf78-47ce-85ee-6b95c71d9d80 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:09.946236 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:09.947154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:09.947442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:09.947718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] PATH_INFO: `/v3/projects/329a15ca31da4d2f8148389b9125c6bb` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:09.948965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=329a15ca31da4d2f8148389b9125c6bb)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:09.951248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:09.962049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:09.963199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:09.963482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:09.963755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] PATH_INFO: `/v3/users/7f7c719bcb9749888818589232aeea99` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:09.971742 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7c719bcb9749888818589232aeea99)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:09.973736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:10.015422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:10.034674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329a15ca31da4d2f8148389b9125c6bb', 'request_id': 'req-0e734530-d5da-4dcd-ad9b-b57049072dbf'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.046935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329a15ca31da4d2f8148389b9125c6bb', 'request_id': 'req-0e734530-d5da-4dcd-ad9b-b57049072dbf'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.067210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329a15ca31da4d2f8148389b9125c6bb', 'request_id': 'req-0e734530-d5da-4dcd-ad9b-b57049072dbf'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.089418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7c719bcb9749888818589232aeea99'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.094583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] The token cache is being invalidate because project 329a15ca31da4d2f8148389b9125c6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:10.094734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.095538 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.097424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1145/2249] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:09 2022] DELETE /identity/v3/projects/329a15ca31da4d2f8148389b9125c6bb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:10.113232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7c719bcb9749888818589232aeea99'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.114009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7c719bcb9749888818589232aeea99'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.123297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7c719bcb9749888818589232aeea99'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.135339 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7c719bcb9749888818589232aeea99'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.145694 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1105/2250] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:09 2022] DELETE /identity/v3/users/7f7c719bcb9749888818589232aeea99 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:10.410225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:10.411807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:10.522671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e734530-d5da-4dcd-ad9b-b57049072dbf admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:10.633978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:10.651317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:10.651587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:10.652069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] PATH_INFO: `/v3/projects/41ed3093e88140089ea2147c3abbffd0` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:10.654053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ed3093e88140089ea2147c3abbffd0)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:10.660343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:10.757802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ed3093e88140089ea2147c3abbffd0', 'request_id': 'req-25854ee6-178d-440b-8108-4835e855fd0c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.776318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ed3093e88140089ea2147c3abbffd0', 'request_id': 'req-25854ee6-178d-440b-8108-4835e855fd0c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.788639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ed3093e88140089ea2147c3abbffd0', 'request_id': 'req-25854ee6-178d-440b-8108-4835e855fd0c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.802697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:10.819304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] The token cache is being invalidate because project 41ed3093e88140089ea2147c3abbffd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:10.820484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.821917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:10.829245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1146/2251] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:10 2022] DELETE /identity/v3/projects/41ed3093e88140089ea2147c3abbffd0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:10.830150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:10.832477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:10.855507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:10.855760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c83bda-2661-48bf-a6cc-9c4d635c4e8b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:10.855893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:10.972103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:10.972302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:10.972596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:10.974664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] PATH_INFO: `/v3/users/a6e85a903e114bc18bf8f336b34d9e39` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:10.977981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e85a903e114bc18bf8f336b34d9e39)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:10.981761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:10.990917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:11.004444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25854ee6-178d-440b-8108-4835e855fd0c admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.013877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.014869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.015225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.015418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] PATH_INFO: `/v3/projects/63e1298908a24a3184ec8116d3832139` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.016729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e1298908a24a3184ec8116d3832139)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.019182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:11.073990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e85a903e114bc18bf8f336b34d9e39'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.084946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e1298908a24a3184ec8116d3832139', 'request_id': 'req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.095169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e1298908a24a3184ec8116d3832139', 'request_id': 'req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.103036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e85a903e114bc18bf8f336b34d9e39'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.103964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e85a903e114bc18bf8f336b34d9e39'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.105027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e1298908a24a3184ec8116d3832139', 'request_id': 'req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.114166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e85a903e114bc18bf8f336b34d9e39'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.117744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] The token cache is being invalidate because project 63e1298908a24a3184ec8116d3832139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:11.117910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.118562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9bee0e3f-f62e-40be-bd8f-e27fda8d91ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.120450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1147/2252] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:10 2022] DELETE /identity/v3/projects/63e1298908a24a3184ec8116d3832139 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:11.125475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7c97b03f-7dbd-4f8d-8c0e-9c1db88173d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e85a903e114bc18bf8f336b34d9e39'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.125704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb782e7-55ce-4926-9731-9b5efa48e6aa None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.126098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb782e7-55ce-4926-9731-9b5efa48e6aa None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.126445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb782e7-55ce-4926-9731-9b5efa48e6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.133969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1106/2253] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:10 2022] DELETE /identity/v3/users/a6e85a903e114bc18bf8f336b34d9e39 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:11.151428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4fb782e7-55ce-4926-9731-9b5efa48e6aa None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:11.152980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4fb782e7-55ce-4926-9731-9b5efa48e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:11.274354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ba867-73b7-4bbb-9d52-9d7df8a59eb4 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.274598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ba867-73b7-4bbb-9d52-9d7df8a59eb4 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.274878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ba867-73b7-4bbb-9d52-9d7df8a59eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.276428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1148/2254] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:11.308614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-796ba867-73b7-4bbb-9d52-9d7df8a59eb4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:11.310774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-796ba867-73b7-4bbb-9d52-9d7df8a59eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:11.329310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1107/2255] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:11.331196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb782e7-55ce-4926-9731-9b5efa48e6aa None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.351199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb782e7-55ce-4926-9731-9b5efa48e6aa None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.361163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab063c-956b-4695-8d92-d16b21370ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.362176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab063c-956b-4695-8d92-d16b21370ebf admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.362822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab063c-956b-4695-8d92-d16b21370ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.363417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab063c-956b-4695-8d92-d16b21370ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.364825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab063c-956b-4695-8d92-d16b21370ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:11.365470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab063c-956b-4695-8d92-d16b21370ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.368743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab063c-956b-4695-8d92-d16b21370ebf admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:11.394242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1149/2256] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:52:11.395444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ba867-73b7-4bbb-9d52-9d7df8a59eb4 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.406758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ba867-73b7-4bbb-9d52-9d7df8a59eb4 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.411985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0b954-8b85-4f44-b209-89dced4d8d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.412665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0b954-8b85-4f44-b209-89dced4d8d08 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.413550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0b954-8b85-4f44-b209-89dced4d8d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.413855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0b954-8b85-4f44-b209-89dced4d8d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.414588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0b954-8b85-4f44-b209-89dced4d8d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.416558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0b954-8b85-4f44-b209-89dced4d8d08 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:11.449019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1108/2257] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:11 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:11.450331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab063c-956b-4695-8d92-d16b21370ebf admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.463165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab063c-956b-4695-8d92-d16b21370ebf admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.482626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:11.486122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0b954-8b85-4f44-b209-89dced4d8d08 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.491591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-50f0b954-8b85-4f44-b209-89dced4d8d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:11.558107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b865e-59e0-4a15-a79e-8cb6204b09da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.559072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b865e-59e0-4a15-a79e-8cb6204b09da admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.559339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b865e-59e0-4a15-a79e-8cb6204b09da admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.559731 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b865e-59e0-4a15-a79e-8cb6204b09da admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.560550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b865e-59e0-4a15-a79e-8cb6204b09da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.562643 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b865e-59e0-4a15-a79e-8cb6204b09da admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:11.587222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1150/2258] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:11 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:11.590909 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0b954-8b85-4f44-b209-89dced4d8d08 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.591494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b865e-59e0-4a15-a79e-8cb6204b09da admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.595785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.596740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.597096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.597437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] PATH_INFO: `/v3/projects/1380dbc642cd44468de98420c664a3be` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.598794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1380dbc642cd44468de98420c664a3be)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.600815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:11.602336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b865e-59e0-4a15-a79e-8cb6204b09da admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.614899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd85dd-1c6a-45e4-a127-f799903a1444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.615682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd85dd-1c6a-45e4-a127-f799903a1444 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.616011 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd85dd-1c6a-45e4-a127-f799903a1444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.616304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd85dd-1c6a-45e4-a127-f799903a1444 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.617111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd85dd-1c6a-45e4-a127-f799903a1444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.619057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd85dd-1c6a-45e4-a127-f799903a1444 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:11.634827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1151/2259] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:52:11.636200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd85dd-1c6a-45e4-a127-f799903a1444 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.646768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd85dd-1c6a-45e4-a127-f799903a1444 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.658769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1380dbc642cd44468de98420c664a3be', 'request_id': 'req-3838a2ac-cc19-4163-aa47-716cf157dc72'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.669009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1380dbc642cd44468de98420c664a3be', 'request_id': 'req-3838a2ac-cc19-4163-aa47-716cf157dc72'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.670876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:11.677624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1380dbc642cd44468de98420c664a3be', 'request_id': 'req-3838a2ac-cc19-4163-aa47-716cf157dc72'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.691913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] The token cache is being invalidate because project 1380dbc642cd44468de98420c664a3be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:11.692328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.693088 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3838a2ac-cc19-4163-aa47-716cf157dc72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:11.695087 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1109/2260] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:11 2022] DELETE /identity/v3/projects/1380dbc642cd44468de98420c664a3be => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:11.701385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08e0f3-a8ae-418e-b7d0-88f1063aa990 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.701668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08e0f3-a8ae-418e-b7d0-88f1063aa990 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.701948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08e0f3-a8ae-418e-b7d0-88f1063aa990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.715651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc504c-0cde-4e6d-a59c-f43ef2c549ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.716284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc504c-0cde-4e6d-a59c-f43ef2c549ef admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.716590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc504c-0cde-4e6d-a59c-f43ef2c549ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.716810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc504c-0cde-4e6d-a59c-f43ef2c549ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.717540 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc504c-0cde-4e6d-a59c-f43ef2c549ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.719176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc504c-0cde-4e6d-a59c-f43ef2c549ef admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:11.723368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-0e08e0f3-a8ae-418e-b7d0-88f1063aa990 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:11.725071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0e08e0f3-a8ae-418e-b7d0-88f1063aa990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:11.730034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1152/2261] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:52:11.741478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc504c-0cde-4e6d-a59c-f43ef2c549ef admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.750532 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1110/2262] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:11.752075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47523a43-df41-4be8-a526-64b12fc89632 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.752360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47523a43-df41-4be8-a526-64b12fc89632 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.752633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47523a43-df41-4be8-a526-64b12fc89632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.772647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-aacc504c-0cde-4e6d-a59c-f43ef2c549ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:11.775575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-47523a43-df41-4be8-a526-64b12fc89632 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:11.776896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-47523a43-df41-4be8-a526-64b12fc89632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:11.788300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1111/2263] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:11.792943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47523a43-df41-4be8-a526-64b12fc89632 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.807066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc504c-0cde-4e6d-a59c-f43ef2c549ef admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.812366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47523a43-df41-4be8-a526-64b12fc89632 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.821608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3c70e-db03-4880-9d22-0da80809dd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.823035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3c70e-db03-4880-9d22-0da80809dd70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.823427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3c70e-db03-4880-9d22-0da80809dd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.824231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3c70e-db03-4880-9d22-0da80809dd70 admin admin] PATH_INFO: `/v3/projects/3f4cec4436444b53a70710d4299f5cf1/users/b08d7e104903411dabff0749075af9fe/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.837842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.841025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.841814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.842702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.846442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:11.847137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.851852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:11.868886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3c70e-db03-4880-9d22-0da80809dd70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4cec4436444b53a70710d4299f5cf1, user_id=b08d7e104903411dabff0749075af9fe, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.875482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3c70e-db03-4880-9d22-0da80809dd70 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:11.875667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1112/2264] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:52:11.875667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.875934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:11.892469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0956d3c-3420-437c-b8a9-a059602f072a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:11.893244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1153/2265] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:11 2022] PUT /identity/v3/projects/3f4cec4436444b53a70710d4299f5cf1/users/b08d7e104903411dabff0749075af9fe/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:11.894428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3c70e-db03-4880-9d22-0da80809dd70 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:11.968944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:11.969819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:11.970158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:11.970433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] PATH_INFO: `/v3/users/740af3545c4b45208d80fa38132b30d6` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:11.971661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740af3545c4b45208d80fa38132b30d6)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:11.973598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.009431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3c70e-db03-4880-9d22-0da80809dd70 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.016896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb76ce-2ea8-42e2-975b-17acf09e70c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.017582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb76ce-2ea8-42e2-975b-17acf09e70c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.017868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb76ce-2ea8-42e2-975b-17acf09e70c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.018150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb76ce-2ea8-42e2-975b-17acf09e70c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.018884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb76ce-2ea8-42e2-975b-17acf09e70c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.020824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb76ce-2ea8-42e2-975b-17acf09e70c5 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.031724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740af3545c4b45208d80fa38132b30d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:12.032280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:12.048091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740af3545c4b45208d80fa38132b30d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:12.049002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740af3545c4b45208d80fa38132b30d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:12.060485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740af3545c4b45208d80fa38132b30d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:12.066361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1154/2266] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:11 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:12.068323 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2788-23fb-416e-8b27-f5c3dc100ecf None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.068725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2788-23fb-416e-8b27-f5c3dc100ecf None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.073346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f2788-23fb-416e-8b27-f5c3dc100ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.075137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740af3545c4b45208d80fa38132b30d6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:12.084144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1113/2267] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:11 2022] DELETE /identity/v3/users/740af3545c4b45208d80fa38132b30d6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:12.085323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.086779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:12.124448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-435f2788-23fb-416e-8b27-f5c3dc100ecf None None] MFA Rules not processed for user `b08d7e104903411dabff0749075af9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:12.124448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-435f2788-23fb-416e-8b27-f5c3dc100ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:12.154276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:12.195198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e6481-5503-4840-a7ad-542260f71c42 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.201140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47747f6-58af-4d36-ae35-72cbe6e64365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.202122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47747f6-58af-4d36-ae35-72cbe6e64365 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.202475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47747f6-58af-4d36-ae35-72cbe6e64365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.202780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47747f6-58af-4d36-ae35-72cbe6e64365 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.203726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47747f6-58af-4d36-ae35-72cbe6e64365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.206697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47747f6-58af-4d36-ae35-72cbe6e64365 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.223864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1155/2268] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:12.226122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398f28-646e-4d5f-a9ab-dde8dde29053 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.226624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398f28-646e-4d5f-a9ab-dde8dde29053 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.226990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398f28-646e-4d5f-a9ab-dde8dde29053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.243501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1114/2269] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:12 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:12.247213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47747f6-58af-4d36-ae35-72cbe6e64365 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.249110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e47747f6-58af-4d36-ae35-72cbe6e64365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:12.249293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-2d398f28-646e-4d5f-a9ab-dde8dde29053 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:12.250566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2d398f28-646e-4d5f-a9ab-dde8dde29053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:12.277620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47747f6-58af-4d36-ae35-72cbe6e64365 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.277620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6501741-fd49-47bf-bc23-b50c6a8d1f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.277620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6501741-fd49-47bf-bc23-b50c6a8d1f64 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.277620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6501741-fd49-47bf-bc23-b50c6a8d1f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.278572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6501741-fd49-47bf-bc23-b50c6a8d1f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.280023 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6501741-fd49-47bf-bc23-b50c6a8d1f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.281983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1156/2270] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:12.283590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398f28-646e-4d5f-a9ab-dde8dde29053 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.289768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6501741-fd49-47bf-bc23-b50c6a8d1f64 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.302408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398f28-646e-4d5f-a9ab-dde8dde29053 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.308804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a945be-4f45-40db-afa6-a8edec97362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.309611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a945be-4f45-40db-afa6-a8edec97362a admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.309962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a945be-4f45-40db-afa6-a8edec97362a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.310703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a945be-4f45-40db-afa6-a8edec97362a admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.311283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a945be-4f45-40db-afa6-a8edec97362a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.322273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a945be-4f45-40db-afa6-a8edec97362a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.327211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1157/2271] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:12.328220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a945be-4f45-40db-afa6-a8edec97362a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.330499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d2a945be-4f45-40db-afa6-a8edec97362a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:12.364344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1115/2272] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:12 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:12.367187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6501741-fd49-47bf-bc23-b50c6a8d1f64 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.410345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a945be-4f45-40db-afa6-a8edec97362a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.470703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea87d-a4aa-4f07-9151-b49041672ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.471378 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea87d-a4aa-4f07-9151-b49041672ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.471587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6501741-fd49-47bf-bc23-b50c6a8d1f64 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.471727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea87d-a4aa-4f07-9151-b49041672ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.472197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea87d-a4aa-4f07-9151-b49041672ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.477803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2749b5-1419-4825-8ffc-ffc2690600d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.478747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2749b5-1419-4825-8ffc-ffc2690600d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.479193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2749b5-1419-4825-8ffc-ffc2690600d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.479464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2749b5-1419-4825-8ffc-ffc2690600d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.480313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2749b5-1419-4825-8ffc-ffc2690600d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.482486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2749b5-1419-4825-8ffc-ffc2690600d3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.485846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea87d-a4aa-4f07-9151-b49041672ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.487393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea87d-a4aa-4f07-9151-b49041672ca8 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.505746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1116/2273] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:12.505746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2749b5-1419-4825-8ffc-ffc2690600d3 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.506001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1158/2274] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:12.506977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea87d-a4aa-4f07-9151-b49041672ca8 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.516947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2749b5-1419-4825-8ffc-ffc2690600d3 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.523939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea87d-a4aa-4f07-9151-b49041672ca8 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.529922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54a44a-8954-49f8-a234-58eb9c37a8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.531102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2d2c-000e-480d-a307-dca15d57ca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.531240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54a44a-8954-49f8-a234-58eb9c37a8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.531240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54a44a-8954-49f8-a234-58eb9c37a8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.531525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2d2c-000e-480d-a307-dca15d57ca2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.532245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54a44a-8954-49f8-a234-58eb9c37a8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.532366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2d2c-000e-480d-a307-dca15d57ca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.532366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2d2c-000e-480d-a307-dca15d57ca2f admin admin] PATH_INFO: `/v3/projects/5735629bb154485091012565f1a3194b/users/88ee39a37f564732a7a5774a40cfedff/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.532739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54a44a-8954-49f8-a234-58eb9c37a8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.534923 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54a44a-8954-49f8-a234-58eb9c37a8e2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.551553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f2d2c-000e-480d-a307-dca15d57ca2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5735629bb154485091012565f1a3194b, user_id=88ee39a37f564732a7a5774a40cfedff, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.561291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f2d2c-000e-480d-a307-dca15d57ca2f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.567297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1117/2275] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:12 2022] POST /identity/v3/users => generated 299 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:12.571774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54a44a-8954-49f8-a234-58eb9c37a8e2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.575865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:12.581623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1159/2276] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:12 2022] PUT /identity/v3/projects/5735629bb154485091012565f1a3194b/users/88ee39a37f564732a7a5774a40cfedff/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:12.586165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54a44a-8954-49f8-a234-58eb9c37a8e2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.587882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886559a9-b4eb-4475-a6ed-135ca6fed08b None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.588078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886559a9-b4eb-4475-a6ed-135ca6fed08b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.588763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886559a9-b4eb-4475-a6ed-135ca6fed08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.624595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-886559a9-b4eb-4475-a6ed-135ca6fed08b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:12.627890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-886559a9-b4eb-4475-a6ed-135ca6fed08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:12.663562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f29f4-6ba9-4214-984b-ccdd8fbd06a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.664509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f29f4-6ba9-4214-984b-ccdd8fbd06a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.665325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f29f4-6ba9-4214-984b-ccdd8fbd06a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.665733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f29f4-6ba9-4214-984b-ccdd8fbd06a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.666910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f29f4-6ba9-4214-984b-ccdd8fbd06a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.670026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f29f4-6ba9-4214-984b-ccdd8fbd06a4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.689920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1118/2277] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:52:12.697316 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f29f4-6ba9-4214-984b-ccdd8fbd06a4 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.727918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1160/2278] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:12.731854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f29f4-6ba9-4214-984b-ccdd8fbd06a4 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.741589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886559a9-b4eb-4475-a6ed-135ca6fed08b None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.742695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2e60f-2bba-44a1-8a5f-a628af5a94f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.743730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-886559a9-b4eb-4475-a6ed-135ca6fed08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:12.744025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2e60f-2bba-44a1-8a5f-a628af5a94f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.744403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2e60f-2bba-44a1-8a5f-a628af5a94f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.744847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2e60f-2bba-44a1-8a5f-a628af5a94f0 admin admin] PATH_INFO: `/v3/projects/d9762d32c65e480d891a72aaa24619b4/users/a029baa51ac04a398d3cee3d1ddaf582/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.768288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2e60f-2bba-44a1-8a5f-a628af5a94f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9762d32c65e480d891a72aaa24619b4, user_id=a029baa51ac04a398d3cee3d1ddaf582, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.772663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2e60f-2bba-44a1-8a5f-a628af5a94f0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.778204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:12.795750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1119/2279] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:12 2022] PUT /identity/v3/projects/d9762d32c65e480d891a72aaa24619b4/users/a029baa51ac04a398d3cee3d1ddaf582/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:12.804410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2e60f-2bba-44a1-8a5f-a628af5a94f0 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.858106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886559a9-b4eb-4475-a6ed-135ca6fed08b None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.908615 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2e60f-2bba-44a1-8a5f-a628af5a94f0 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.915571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fe45c-0f57-4eac-9b54-79c720089af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.916498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fe45c-0f57-4eac-9b54-79c720089af2 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.916775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fe45c-0f57-4eac-9b54-79c720089af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.917052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fe45c-0f57-4eac-9b54-79c720089af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.918219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fe45c-0f57-4eac-9b54-79c720089af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.919654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fe45c-0f57-4eac-9b54-79c720089af2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.932849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1172e4-7a36-4d54-b800-ed751792afeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.933584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1172e4-7a36-4d54-b800-ed751792afeb service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.933781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1172e4-7a36-4d54-b800-ed751792afeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.934064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1172e4-7a36-4d54-b800-ed751792afeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.935472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1120/2280] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:52:12.936355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fe45c-0f57-4eac-9b54-79c720089af2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.938282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-442fe45c-0f57-4eac-9b54-79c720089af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:12.944986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1172e4-7a36-4d54-b800-ed751792afeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.947186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1172e4-7a36-4d54-b800-ed751792afeb service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.952154 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fe45c-0f57-4eac-9b54-79c720089af2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.958176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:12.959268 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:12.960106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:12.960485 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] PATH_INFO: `/v3/projects/abb30e4238e541efb915fc827e543711` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:12.961624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb30e4238e541efb915fc827e543711)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:12.963483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1161/2281] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:52:12.963976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:12.971701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1172e4-7a36-4d54-b800-ed751792afeb service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:12.986645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1172e4-7a36-4d54-b800-ed751792afeb service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:12.998535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd92a4-2d56-46f6-91af-a2b89bd32cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:13.000502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd92a4-2d56-46f6-91af-a2b89bd32cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.000895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd92a4-2d56-46f6-91af-a2b89bd32cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.001409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd92a4-2d56-46f6-91af-a2b89bd32cd3 admin admin] PATH_INFO: `/v3/projects/d9762d32c65e480d891a72aaa24619b4/users/a029baa51ac04a398d3cee3d1ddaf582/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.005387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd92a4-2d56-46f6-91af-a2b89bd32cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9762d32c65e480d891a72aaa24619b4, user_id=a029baa51ac04a398d3cee3d1ddaf582, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:13.011777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd92a4-2d56-46f6-91af-a2b89bd32cd3 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:13.028188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1162/2282] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:12 2022] PUT /identity/v3/projects/d9762d32c65e480d891a72aaa24619b4/users/a029baa51ac04a398d3cee3d1ddaf582/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:13.039128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292655c-62d5-44f3-9db9-f556ae944370 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.039641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292655c-62d5-44f3-9db9-f556ae944370 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.039927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292655c-62d5-44f3-9db9-f556ae944370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.041947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb30e4238e541efb915fc827e543711', 'request_id': 'req-2629374d-f300-4939-83b1-70038a9ae3cc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:13.052030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb30e4238e541efb915fc827e543711', 'request_id': 'req-2629374d-f300-4939-83b1-70038a9ae3cc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:13.064590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb30e4238e541efb915fc827e543711', 'request_id': 'req-2629374d-f300-4939-83b1-70038a9ae3cc'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:13.071476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-8292655c-62d5-44f3-9db9-f556ae944370 None None] MFA Rules not processed for user `a029baa51ac04a398d3cee3d1ddaf582`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:13.072871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8292655c-62d5-44f3-9db9-f556ae944370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:13.090702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] The token cache is being invalidate because project abb30e4238e541efb915fc827e543711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:13.091233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:13.092812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2629374d-f300-4939-83b1-70038a9ae3cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:13.096285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1121/2283] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:12 2022] DELETE /identity/v3/projects/abb30e4238e541efb915fc827e543711 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:13.103857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd30ab-b610-439c-aec9-37da0d3f8916 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.104313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd30ab-b610-439c-aec9-37da0d3f8916 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.104527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd30ab-b610-439c-aec9-37da0d3f8916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.138412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-01cd30ab-b610-439c-aec9-37da0d3f8916 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:13.140577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:13.142241 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-01cd30ab-b610-439c-aec9-37da0d3f8916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:13.191809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1163/2284] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:13.200464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292655c-62d5-44f3-9db9-f556ae944370 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:13.206217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8292655c-62d5-44f3-9db9-f556ae944370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:13.261972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1122/2285] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:13.276119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6af18-e141-4f6b-b4f1-81d11ce1153d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.276435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6af18-e141-4f6b-b4f1-81d11ce1153d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.276878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6af18-e141-4f6b-b4f1-81d11ce1153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.300318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a6a6af18-e141-4f6b-b4f1-81d11ce1153d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:13.301701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a6a6af18-e141-4f6b-b4f1-81d11ce1153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:13.311151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1123/2286] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:13.317257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6af18-e141-4f6b-b4f1-81d11ce1153d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:13.329409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292655c-62d5-44f3-9db9-f556ae944370 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:13.331369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6af18-e141-4f6b-b4f1-81d11ce1153d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:13.333975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdad94-117a-45c7-898f-0e3595f00d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:13.334877 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdad94-117a-45c7-898f-0e3595f00d60 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.335169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdad94-117a-45c7-898f-0e3595f00d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.335448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdad94-117a-45c7-898f-0e3595f00d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.341575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facb0d9-1470-4987-831a-72432de91d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:13.344331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facb0d9-1470-4987-831a-72432de91d3d admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.344890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facb0d9-1470-4987-831a-72432de91d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.345409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facb0d9-1470-4987-831a-72432de91d3d admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.346753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdad94-117a-45c7-898f-0e3595f00d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:13.347296 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facb0d9-1470-4987-831a-72432de91d3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:13.347872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facb0d9-1470-4987-831a-72432de91d3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:13.348226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdad94-117a-45c7-898f-0e3595f00d60 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:13.351738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facb0d9-1470-4987-831a-72432de91d3d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:13.358764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:13.361869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1164/2287] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:52:13.378658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1124/2288] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:52:13.380790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdad94-117a-45c7-898f-0e3595f00d60 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:13.399659 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdad94-117a-45c7-898f-0e3595f00d60 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:13.407237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a87b5d-6fd4-4821-bd8f-cc9bf22f7ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:13.408461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a87b5d-6fd4-4821-bd8f-cc9bf22f7ccb admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.408756 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a87b5d-6fd4-4821-bd8f-cc9bf22f7ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.409037 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a87b5d-6fd4-4821-bd8f-cc9bf22f7ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.409813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a87b5d-6fd4-4821-bd8f-cc9bf22f7ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:13.413644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a87b5d-6fd4-4821-bd8f-cc9bf22f7ccb admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:13.452572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1165/2289] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:13 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:52:13.452738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facb0d9-1470-4987-831a-72432de91d3d admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:13.465489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facb0d9-1470-4987-831a-72432de91d3d admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:13.633843 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83aeb5-f4be-46ef-b96e-90da22ad9b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:13.634580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83aeb5-f4be-46ef-b96e-90da22ad9b2d admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.634867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83aeb5-f4be-46ef-b96e-90da22ad9b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.635151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83aeb5-f4be-46ef-b96e-90da22ad9b2d admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.638107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83aeb5-f4be-46ef-b96e-90da22ad9b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:13.642594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83aeb5-f4be-46ef-b96e-90da22ad9b2d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:13.710740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a87b5d-6fd4-4821-bd8f-cc9bf22f7ccb admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:13.711244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1125/2290] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:13 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:13.732085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a87b5d-6fd4-4821-bd8f-cc9bf22f7ccb admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:13.738587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a89cac-1cb5-49c8-a91f-181e1de88d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:13.739997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89cac-1cb5-49c8-a91f-181e1de88d78 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.740298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89cac-1cb5-49c8-a91f-181e1de88d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.740579 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a89cac-1cb5-49c8-a91f-181e1de88d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.741596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a89cac-1cb5-49c8-a91f-181e1de88d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:13.745601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a89cac-1cb5-49c8-a91f-181e1de88d78 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:13.777850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83aeb5-f4be-46ef-b96e-90da22ad9b2d admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:13.786195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1166/2291] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:13.796042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83aeb5-f4be-46ef-b96e-90da22ad9b2d admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:13.811969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34877d2-4669-4540-aaca-0c495b085f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:13.811969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34877d2-4669-4540-aaca-0c495b085f34 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.827623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34877d2-4669-4540-aaca-0c495b085f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.828116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34877d2-4669-4540-aaca-0c495b085f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.833098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34877d2-4669-4540-aaca-0c495b085f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:13.843495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34877d2-4669-4540-aaca-0c495b085f34 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:13.877825 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1126/2292] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:13.886217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a89cac-1cb5-49c8-a91f-181e1de88d78 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:13.931498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a89cac-1cb5-49c8-a91f-181e1de88d78 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:13.948472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53c9b1-dc4d-4b78-9781-7720d6e27318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:13.952620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53c9b1-dc4d-4b78-9781-7720d6e27318 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:13.953086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53c9b1-dc4d-4b78-9781-7720d6e27318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:13.954946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53c9b1-dc4d-4b78-9781-7720d6e27318 admin admin] PATH_INFO: `/v3/projects/74a820b6625f4ece996c12055dd1d70f/users/515fc2e8acaf4c419f005215e70c9c75/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:13.986143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53c9b1-dc4d-4b78-9781-7720d6e27318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a820b6625f4ece996c12055dd1d70f, user_id=515fc2e8acaf4c419f005215e70c9c75, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:13.988900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53c9b1-dc4d-4b78-9781-7720d6e27318 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:14.010404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1167/2293] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:13 2022] PUT /identity/v3/projects/74a820b6625f4ece996c12055dd1d70f/users/515fc2e8acaf4c419f005215e70c9c75/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:14.021232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac7fa5-5097-4e6b-9b7b-623f69aae128 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:14.021768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac7fa5-5097-4e6b-9b7b-623f69aae128 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:14.021768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac7fa5-5097-4e6b-9b7b-623f69aae128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:14.059292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-45ac7fa5-5097-4e6b-9b7b-623f69aae128 None None] MFA Rules not processed for user `515fc2e8acaf4c419f005215e70c9c75`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:14.060575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-45ac7fa5-5097-4e6b-9b7b-623f69aae128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:14.172189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1127/2294] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:14.201409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53c9b1-dc4d-4b78-9781-7720d6e27318 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:14.205092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-eb53c9b1-dc4d-4b78-9781-7720d6e27318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:14.321768 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53c9b1-dc4d-4b78-9781-7720d6e27318 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:14.329873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ceb0-37bb-43ce-bb8c-78001cf60cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:14.330744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ceb0-37bb-43ce-bb8c-78001cf60cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:14.331101 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ceb0-37bb-43ce-bb8c-78001cf60cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:14.331448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ceb0-37bb-43ce-bb8c-78001cf60cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:14.350021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ceb0-37bb-43ce-bb8c-78001cf60cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:14.351797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ceb0-37bb-43ce-bb8c-78001cf60cc4 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:14.364641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1168/2295] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:14.431205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac7fa5-5097-4e6b-9b7b-623f69aae128 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:14.433531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-45ac7fa5-5097-4e6b-9b7b-623f69aae128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:14.477751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea77d59-3d4f-4f93-81fc-042352a4dcf1 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:14.478118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea77d59-3d4f-4f93-81fc-042352a4dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:14.478430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea77d59-3d4f-4f93-81fc-042352a4dcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:14.542288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4ea77d59-3d4f-4f93-81fc-042352a4dcf1 None None] MFA Rules not processed for user `88ee39a37f564732a7a5774a40cfedff`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:14.543566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4ea77d59-3d4f-4f93-81fc-042352a4dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:14.557697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:14.585665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac7fa5-5097-4e6b-9b7b-623f69aae128 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:14.596855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:14.601594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:14.602441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:14.602923 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] PATH_INFO: `/v3/users/b08d7e104903411dabff0749075af9fe` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:14.605539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08d7e104903411dabff0749075af9fe)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:14.608982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:14.620165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:14.724104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1169/2296] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:14.737526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea77d59-3d4f-4f93-81fc-042352a4dcf1 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:14.761772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea77d59-3d4f-4f93-81fc-042352a4dcf1 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:14.769277 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08d7e104903411dabff0749075af9fe'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:14.774742 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f0b33-e471-4b29-888b-b9aab27d8370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:14.775412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0b33-e471-4b29-888b-b9aab27d8370 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:14.776035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0b33-e471-4b29-888b-b9aab27d8370 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:14.776293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0b33-e471-4b29-888b-b9aab27d8370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:14.798846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f0b33-e471-4b29-888b-b9aab27d8370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:14.801435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f0b33-e471-4b29-888b-b9aab27d8370 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:14.806156 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08d7e104903411dabff0749075af9fe'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:14.819317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08d7e104903411dabff0749075af9fe'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:14.834554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1170/2297] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:14.851139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08d7e104903411dabff0749075af9fe'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:14.878193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08d7e104903411dabff0749075af9fe'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:14.937297 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1128/2298] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:14 2022] DELETE /identity/v3/users/b08d7e104903411dabff0749075af9fe => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:14.942760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bdb40-4c24-4a19-b1b5-89c6081e204d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:14.943358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bdb40-4c24-4a19-b1b5-89c6081e204d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:14.944222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bdb40-4c24-4a19-b1b5-89c6081e204d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:15.001313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-500bdb40-4c24-4a19-b1b5-89c6081e204d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:15.002745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-500bdb40-4c24-4a19-b1b5-89c6081e204d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:15.125037 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1171/2299] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:15.140149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:15.145493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:15.271665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01364a3a-0f93-4f34-9d3d-c451459a326b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:15.278467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839af9-6f62-41fd-b4d1-3fcf908fcd8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:15.279657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839af9-6f62-41fd-b4d1-3fcf908fcd8a service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:15.280204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839af9-6f62-41fd-b4d1-3fcf908fcd8a service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:15.280740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839af9-6f62-41fd-b4d1-3fcf908fcd8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:15.295315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81839af9-6f62-41fd-b4d1-3fcf908fcd8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:15.297848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81839af9-6f62-41fd-b4d1-3fcf908fcd8a service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:15.312093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1129/2300] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:15.688834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bdb40-4c24-4a19-b1b5-89c6081e204d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:15.690444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-500bdb40-4c24-4a19-b1b5-89c6081e204d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:15.703102 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bdb40-4c24-4a19-b1b5-89c6081e204d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:15.708052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:15.710042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:15.710042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:15.710042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] PATH_INFO: `/v3/projects/3f4cec4436444b53a70710d4299f5cf1` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:15.711239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4cec4436444b53a70710d4299f5cf1)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:15.713175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:15.768389 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4cec4436444b53a70710d4299f5cf1', 'request_id': 'req-101a0454-292a-4654-af63-f58f03484790'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:15.776128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4cec4436444b53a70710d4299f5cf1', 'request_id': 'req-101a0454-292a-4654-af63-f58f03484790'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:15.785639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4cec4436444b53a70710d4299f5cf1', 'request_id': 'req-101a0454-292a-4654-af63-f58f03484790'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:15.800387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] The token cache is being invalidate because project 3f4cec4436444b53a70710d4299f5cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:15.800671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:15.801346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-101a0454-292a-4654-af63-f58f03484790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:15.804449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1172/2301] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:15 2022] DELETE /identity/v3/projects/3f4cec4436444b53a70710d4299f5cf1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:15.808075 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839af9-6f62-41fd-b4d1-3fcf908fcd8a service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:15.818252 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839af9-6f62-41fd-b4d1-3fcf908fcd8a service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:15.900736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:15.901617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:15.901897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:15.902171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] PATH_INFO: `/v3/users/a029baa51ac04a398d3cee3d1ddaf582` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:15.903447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a029baa51ac04a398d3cee3d1ddaf582)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:15.905385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:15.938195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:15.972167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a029baa51ac04a398d3cee3d1ddaf582'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:15.995171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a029baa51ac04a398d3cee3d1ddaf582'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:15.996707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a029baa51ac04a398d3cee3d1ddaf582'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:16.008597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a029baa51ac04a398d3cee3d1ddaf582'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:16.020969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a029baa51ac04a398d3cee3d1ddaf582'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:16.029822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1130/2302] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:15 2022] DELETE /identity/v3/users/a029baa51ac04a398d3cee3d1ddaf582 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:16.607924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778415cd-38b9-4a17-a2cb-8ef98460f468 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:16.608779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778415cd-38b9-4a17-a2cb-8ef98460f468 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:16.609482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778415cd-38b9-4a17-a2cb-8ef98460f468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:16.648641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-778415cd-38b9-4a17-a2cb-8ef98460f468 None None] MFA Rules not processed for user `88ee39a37f564732a7a5774a40cfedff`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:16.651536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-778415cd-38b9-4a17-a2cb-8ef98460f468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:16.655648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:16.657291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:16.679698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:16.769227 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1173/2303] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:16.832491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536ada9-de99-4bab-8e85-50f3f4a10935 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:16.840518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:16.841641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:16.842128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:16.842643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] PATH_INFO: `/v3/projects/d9762d32c65e480d891a72aaa24619b4` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:16.844275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9762d32c65e480d891a72aaa24619b4)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:16.847239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:16.934034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9762d32c65e480d891a72aaa24619b4', 'request_id': 'req-ed165363-6fd9-488e-9250-86b42e482629'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:16.948208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9762d32c65e480d891a72aaa24619b4', 'request_id': 'req-ed165363-6fd9-488e-9250-86b42e482629'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:16.962295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9762d32c65e480d891a72aaa24619b4', 'request_id': 'req-ed165363-6fd9-488e-9250-86b42e482629'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:16.982177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] The token cache is being invalidate because project d9762d32c65e480d891a72aaa24619b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:16.982701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:16.983611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ed165363-6fd9-488e-9250-86b42e482629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:16.985551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1131/2304] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:16 2022] DELETE /identity/v3/projects/d9762d32c65e480d891a72aaa24619b4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:16.992060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e13476-7ddd-4efe-a970-8f6ed8ca8f12 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:16.992454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e13476-7ddd-4efe-a970-8f6ed8ca8f12 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:16.992830 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e13476-7ddd-4efe-a970-8f6ed8ca8f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.016644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-75e13476-7ddd-4efe-a970-8f6ed8ca8f12 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:17.017985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-75e13476-7ddd-4efe-a970-8f6ed8ca8f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:17.106437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1174/2305] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:17.112327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e2c00-cce4-4226-960f-3a7a1655dc7a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.112866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e2c00-cce4-4226-960f-3a7a1655dc7a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.113399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e2c00-cce4-4226-960f-3a7a1655dc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.149830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-438e2c00-cce4-4226-960f-3a7a1655dc7a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:17.152111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-438e2c00-cce4-4226-960f-3a7a1655dc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:17.165097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1132/2306] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:17.169393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e13476-7ddd-4efe-a970-8f6ed8ca8f12 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:17.180618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e13476-7ddd-4efe-a970-8f6ed8ca8f12 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:17.185431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d303e1-9e89-4285-8f6f-672d5f9bb1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:17.186093 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d303e1-9e89-4285-8f6f-672d5f9bb1aa admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.186372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d303e1-9e89-4285-8f6f-672d5f9bb1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.186677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d303e1-9e89-4285-8f6f-672d5f9bb1aa admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.187403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d303e1-9e89-4285-8f6f-672d5f9bb1aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:17.187707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d303e1-9e89-4285-8f6f-672d5f9bb1aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:17.189294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d303e1-9e89-4285-8f6f-672d5f9bb1aa admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:17.202155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1175/2307] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:52:17.206904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e2c00-cce4-4226-960f-3a7a1655dc7a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:17.217400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e2c00-cce4-4226-960f-3a7a1655dc7a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:17.222886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592045-bc6f-42e0-b483-118f70e6885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:17.223836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592045-bc6f-42e0-b483-118f70e6885a admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.224119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592045-bc6f-42e0-b483-118f70e6885a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.224420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592045-bc6f-42e0-b483-118f70e6885a admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.225269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d592045-bc6f-42e0-b483-118f70e6885a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:17.227240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d592045-bc6f-42e0-b483-118f70e6885a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:17.261834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1133/2308] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:17 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:17.269379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d303e1-9e89-4285-8f6f-672d5f9bb1aa admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:17.288264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d303e1-9e89-4285-8f6f-672d5f9bb1aa admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:17.383356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347c13e-c1e1-4f5c-8344-ad012c4631c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:17.384594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347c13e-c1e1-4f5c-8344-ad012c4631c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.384594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347c13e-c1e1-4f5c-8344-ad012c4631c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.384858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347c13e-c1e1-4f5c-8344-ad012c4631c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.385325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347c13e-c1e1-4f5c-8344-ad012c4631c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:17.387443 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347c13e-c1e1-4f5c-8344-ad012c4631c6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:17.418540 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1176/2309] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:17 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:17.422611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592045-bc6f-42e0-b483-118f70e6885a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:17.434675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592045-bc6f-42e0-b483-118f70e6885a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:17.439487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca171198-9454-4afb-8934-a6ecc45790f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:17.440871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca171198-9454-4afb-8934-a6ecc45790f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.440871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca171198-9454-4afb-8934-a6ecc45790f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.440871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca171198-9454-4afb-8934-a6ecc45790f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.441473 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca171198-9454-4afb-8934-a6ecc45790f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:17.443161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca171198-9454-4afb-8934-a6ecc45790f3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:17.444782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:17.462118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1134/2310] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:17.465924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347c13e-c1e1-4f5c-8344-ad012c4631c6 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:17.477026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347c13e-c1e1-4f5c-8344-ad012c4631c6 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:17.483345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ac8f-5607-4ea6-9b63-ff43e658e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:17.485107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ac8f-5607-4ea6-9b63-ff43e658e1ab admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.485411 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ac8f-5607-4ea6-9b63-ff43e658e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.485686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ac8f-5607-4ea6-9b63-ff43e658e1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.486470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83ac8f-5607-4ea6-9b63-ff43e658e1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:17.488348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83ac8f-5607-4ea6-9b63-ff43e658e1ab admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:17.501499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1177/2311] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:17.509533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca171198-9454-4afb-8934-a6ecc45790f3 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:17.523010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca171198-9454-4afb-8934-a6ecc45790f3 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:17.529083 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb0145-ef24-470d-a702-9fe331781cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:17.530761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb0145-ef24-470d-a702-9fe331781cea admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.530761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb0145-ef24-470d-a702-9fe331781cea admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.530761 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb0145-ef24-470d-a702-9fe331781cea admin admin] PATH_INFO: `/v3/projects/0fc0e45eab5d4989b92f4b2933b5df24/users/0a5776b5796044f4b8db3b7ffac5940c/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.553750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb0145-ef24-470d-a702-9fe331781cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc0e45eab5d4989b92f4b2933b5df24, user_id=0a5776b5796044f4b8db3b7ffac5940c, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:17.556568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb0145-ef24-470d-a702-9fe331781cea admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:17.574860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1135/2312] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:17 2022] PUT /identity/v3/projects/0fc0e45eab5d4989b92f4b2933b5df24/users/0a5776b5796044f4b8db3b7ffac5940c/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:17.581667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3eedd-f8bc-4f49-a355-b9951c158e94 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.582091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3eedd-f8bc-4f49-a355-b9951c158e94 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.582428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3eedd-f8bc-4f49-a355-b9951c158e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.600580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb0145-ef24-470d-a702-9fe331781cea admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:17.602361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-93cb0145-ef24-470d-a702-9fe331781cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:17.604502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-faa3eedd-f8bc-4f49-a355-b9951c158e94 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:17.606024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-faa3eedd-f8bc-4f49-a355-b9951c158e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:17.639901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:17.673024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb0145-ef24-470d-a702-9fe331781cea admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:17.685153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:17.686780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.687072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.687374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] PATH_INFO: `/v3/users/515fc2e8acaf4c419f005215e70c9c75` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.689285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] RBAC: Authorizing `identity:delete_user(user_id=515fc2e8acaf4c419f005215e70c9c75)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:17.691967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:17.711426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1178/2313] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:17.725533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3eedd-f8bc-4f49-a355-b9951c158e94 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:17.727503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-faa3eedd-f8bc-4f49-a355-b9951c158e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:17.763058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515fc2e8acaf4c419f005215e70c9c75'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:17.787399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515fc2e8acaf4c419f005215e70c9c75'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:17.789090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515fc2e8acaf4c419f005215e70c9c75'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:17.802452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3eedd-f8bc-4f49-a355-b9951c158e94 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:17.805235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515fc2e8acaf4c419f005215e70c9c75'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:17.807862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:17.808604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.808889 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.809154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.812067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:17.819912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-182b26b9-7120-4e72-a6b8-044dea26eeda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515fc2e8acaf4c419f005215e70c9c75'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:17.828018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:17.829542 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:17.834012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1136/2314] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:17 2022] DELETE /identity/v3/users/515fc2e8acaf4c419f005215e70c9c75 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:17.840493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd919ae-d62f-4143-aac8-a3399dae376c None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:17.841030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd919ae-d62f-4143-aac8-a3399dae376c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:17.841957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd919ae-d62f-4143-aac8-a3399dae376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:17.864799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1179/2315] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:52:17.867719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2dd919ae-d62f-4143-aac8-a3399dae376c None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:17.870004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2dd919ae-d62f-4143-aac8-a3399dae376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:18.019750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:18.072530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1137/2316] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:18.098015 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:18.100169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:18.126818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cbc2f-c2b9-4d6d-935d-bd6507c3936a service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:18.281972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd8b0-a141-44e6-b459-667e158c3b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:18.282922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd8b0-a141-44e6-b459-667e158c3b4f service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:18.283325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd8b0-a141-44e6-b459-667e158c3b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:18.284018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd8b0-a141-44e6-b459-667e158c3b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:18.298170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd8b0-a141-44e6-b459-667e158c3b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:18.299655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd8b0-a141-44e6-b459-667e158c3b4f service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:18.312460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1180/2317] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:18.840476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd919ae-d62f-4143-aac8-a3399dae376c None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:18.842837 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2dd919ae-d62f-4143-aac8-a3399dae376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:18.858419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd919ae-d62f-4143-aac8-a3399dae376c None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:18.866208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:18.867298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:18.868123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:18.868399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] PATH_INFO: `/v3/projects/74a820b6625f4ece996c12055dd1d70f` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:18.870170 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a820b6625f4ece996c12055dd1d70f)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:18.872195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:18.966660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a820b6625f4ece996c12055dd1d70f', 'request_id': 'req-599503e5-127d-4412-bbd1-2a8cab338515'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:18.980955 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a820b6625f4ece996c12055dd1d70f', 'request_id': 'req-599503e5-127d-4412-bbd1-2a8cab338515'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:18.989620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a820b6625f4ece996c12055dd1d70f', 'request_id': 'req-599503e5-127d-4412-bbd1-2a8cab338515'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:19.011262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] The token cache is being invalidate because project 74a820b6625f4ece996c12055dd1d70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:19.011706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:19.012704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-599503e5-127d-4412-bbd1-2a8cab338515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:19.018320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1138/2318] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:18 2022] DELETE /identity/v3/projects/74a820b6625f4ece996c12055dd1d70f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:19.020917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8b08c-56b5-4a51-b378-bc4d25189594 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:19.021789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8b08c-56b5-4a51-b378-bc4d25189594 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:19.022246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8b08c-56b5-4a51-b378-bc4d25189594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:19.046350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1ba8b08c-56b5-4a51-b378-bc4d25189594 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:19.048409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1ba8b08c-56b5-4a51-b378-bc4d25189594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:19.148311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1181/2319] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:19.156354 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70736b6-0fbd-4442-b184-42657fd5f35b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:19.156652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70736b6-0fbd-4442-b184-42657fd5f35b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:19.156931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70736b6-0fbd-4442-b184-42657fd5f35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:19.181702 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c70736b6-0fbd-4442-b184-42657fd5f35b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:19.183579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c70736b6-0fbd-4442-b184-42657fd5f35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:19.194120 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1139/2320] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:19.200108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8b08c-56b5-4a51-b378-bc4d25189594 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:19.227125 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8b08c-56b5-4a51-b378-bc4d25189594 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:19.239110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a2c4-53a6-4815-8ee9-b266ed89a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:19.242372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a2c4-53a6-4815-8ee9-b266ed89a1bb admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:19.242957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a2c4-53a6-4815-8ee9-b266ed89a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:19.243493 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213a2c4-53a6-4815-8ee9-b266ed89a1bb admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:19.245962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213a2c4-53a6-4815-8ee9-b266ed89a1bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:19.246592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213a2c4-53a6-4815-8ee9-b266ed89a1bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:19.249885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213a2c4-53a6-4815-8ee9-b266ed89a1bb admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:19.299448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1182/2321] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:52:19.305475 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70736b6-0fbd-4442-b184-42657fd5f35b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:19.323852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70736b6-0fbd-4442-b184-42657fd5f35b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:19.331012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba811c-4e05-44af-b081-4b6e02af3ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:19.331903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba811c-4e05-44af-b081-4b6e02af3ecc admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:19.332259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba811c-4e05-44af-b081-4b6e02af3ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:19.332543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba811c-4e05-44af-b081-4b6e02af3ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:19.333210 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba811c-4e05-44af-b081-4b6e02af3ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:19.336589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba811c-4e05-44af-b081-4b6e02af3ecc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:19.378309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1140/2322] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:19 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:19.391498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a2c4-53a6-4815-8ee9-b266ed89a1bb admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:19.397313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:19.405484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213a2c4-53a6-4815-8ee9-b266ed89a1bb admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:19.526578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cef59b-1aaa-4380-b37c-79fecb330ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:19.527333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cef59b-1aaa-4380-b37c-79fecb330ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:19.527619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cef59b-1aaa-4380-b37c-79fecb330ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:19.528021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cef59b-1aaa-4380-b37c-79fecb330ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:19.528868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cef59b-1aaa-4380-b37c-79fecb330ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:19.533194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cef59b-1aaa-4380-b37c-79fecb330ca2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:19.575150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1183/2323] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:19 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:19.579451 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba811c-4e05-44af-b081-4b6e02af3ecc admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:19.593387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba811c-4e05-44af-b081-4b6e02af3ecc admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:19.600479 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ba442-e3e4-47b5-b3e2-c7dde137e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:19.601173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ba442-e3e4-47b5-b3e2-c7dde137e0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:19.601624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ba442-e3e4-47b5-b3e2-c7dde137e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:19.601985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ba442-e3e4-47b5-b3e2-c7dde137e0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:19.602813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ba442-e3e4-47b5-b3e2-c7dde137e0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:19.605405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ba442-e3e4-47b5-b3e2-c7dde137e0a1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:19.627291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1141/2324] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:19.629027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cef59b-1aaa-4380-b37c-79fecb330ca2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:19.641955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cef59b-1aaa-4380-b37c-79fecb330ca2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:19.648479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea6cfb-1015-449f-a1e3-3f575ddbac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:19.649857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6cfb-1015-449f-a1e3-3f575ddbac1a admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:19.650363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6cfb-1015-449f-a1e3-3f575ddbac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:19.651062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6cfb-1015-449f-a1e3-3f575ddbac1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:19.651903 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea6cfb-1015-449f-a1e3-3f575ddbac1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:19.653685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea6cfb-1015-449f-a1e3-3f575ddbac1a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:19.668889 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1184/2325] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:52:19.670507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ba442-e3e4-47b5-b3e2-c7dde137e0a1 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:19.687992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ba442-e3e4-47b5-b3e2-c7dde137e0a1 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:19.696162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfdf77-9334-4c11-8a52-55a41d146a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:19.697407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfdf77-9334-4c11-8a52-55a41d146a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:19.697885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfdf77-9334-4c11-8a52-55a41d146a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:19.698405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfdf77-9334-4c11-8a52-55a41d146a38 admin admin] PATH_INFO: `/v3/projects/188b3011c4d44e318a6e0cf27510801a/users/6ed5aedf7fe64602bd69b8d25a77d320/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:19.731978 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfdf77-9334-4c11-8a52-55a41d146a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188b3011c4d44e318a6e0cf27510801a, user_id=6ed5aedf7fe64602bd69b8d25a77d320, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:19.734885 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfdf77-9334-4c11-8a52-55a41d146a38 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:19.767019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1142/2326] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:19 2022] PUT /identity/v3/projects/188b3011c4d44e318a6e0cf27510801a/users/6ed5aedf7fe64602bd69b8d25a77d320/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:19.779448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10641-05a9-4502-8749-c014d00a81f6 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:19.779926 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10641-05a9-4502-8749-c014d00a81f6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:19.780354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10641-05a9-4502-8749-c014d00a81f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:19.841460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-72b10641-05a9-4502-8749-c014d00a81f6 None None] MFA Rules not processed for user `6ed5aedf7fe64602bd69b8d25a77d320`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:19.842778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-72b10641-05a9-4502-8749-c014d00a81f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:20.014397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1185/2327] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:20.026130 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfdf77-9334-4c11-8a52-55a41d146a38 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:20.027948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1edfdf77-9334-4c11-8a52-55a41d146a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:20.151469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfdf77-9334-4c11-8a52-55a41d146a38 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:20.167267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c281ec-4e20-4212-8400-a6c7d0d414d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:20.169098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c281ec-4e20-4212-8400-a6c7d0d414d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:20.169990 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c281ec-4e20-4212-8400-a6c7d0d414d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:20.170506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c281ec-4e20-4212-8400-a6c7d0d414d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:20.233678 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c281ec-4e20-4212-8400-a6c7d0d414d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:20.235416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c281ec-4e20-4212-8400-a6c7d0d414d5 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:20.252692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1143/2328] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:20.310770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a91d5-9ea7-46b8-b548-8fd780b365a1 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:20.311275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a91d5-9ea7-46b8-b548-8fd780b365a1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:20.311410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a91d5-9ea7-46b8-b548-8fd780b365a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:20.351285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-fa6a91d5-9ea7-46b8-b548-8fd780b365a1 None None] MFA Rules not processed for user `f6525af49ffc42269f0883827ccf7e10`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:20.353188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-fa6a91d5-9ea7-46b8-b548-8fd780b365a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:20.529596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1186/2329] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:26.915626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4857a3e-8b6c-42f5-a1f2-e51a1d5a7fbc None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:26.916361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4857a3e-8b6c-42f5-a1f2-e51a1d5a7fbc None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:26.917054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4857a3e-8b6c-42f5-a1f2-e51a1d5a7fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:26.970272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:27.002595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f4857a3e-8b6c-42f5-a1f2-e51a1d5a7fbc None None] MFA Rules not processed for user `0a5776b5796044f4b8db3b7ffac5940c`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:27.003950 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f4857a3e-8b6c-42f5-a1f2-e51a1d5a7fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:27.176308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1144/2330] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:27.178346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a91d5-9ea7-46b8-b548-8fd780b365a1 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:27.185325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-fa6a91d5-9ea7-46b8-b548-8fd780b365a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:27.230427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:27.503529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a91d5-9ea7-46b8-b548-8fd780b365a1 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:27.517663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a8369-5155-45f8-9e22-e46134630198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:27.518799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a8369-5155-45f8-9e22-e46134630198 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:27.519195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a8369-5155-45f8-9e22-e46134630198 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:27.519660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a8369-5155-45f8-9e22-e46134630198 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:27.520478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a8369-5155-45f8-9e22-e46134630198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:27.527904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a8369-5155-45f8-9e22-e46134630198 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:27.604217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1187/2331] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:27 2022] POST /identity/v3/projects => generated 373 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:27.605149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4857a3e-8b6c-42f5-a1f2-e51a1d5a7fbc None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:27.623874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4857a3e-8b6c-42f5-a1f2-e51a1d5a7fbc None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:27.768975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b5ed-0ebe-4e61-8b10-5c8164891594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:27.769683 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b5ed-0ebe-4e61-8b10-5c8164891594 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:27.770017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b5ed-0ebe-4e61-8b10-5c8164891594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:27.770292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b5ed-0ebe-4e61-8b10-5c8164891594 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:27.770960 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b5ed-0ebe-4e61-8b10-5c8164891594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:27.773811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b5ed-0ebe-4e61-8b10-5c8164891594 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:27.839581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1145/2332] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:27 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:27.843054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a8369-5155-45f8-9e22-e46134630198 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:27.909915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a8369-5155-45f8-9e22-e46134630198 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:27.948966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b65db-718b-41eb-846c-e5031791eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:27.949658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b65db-718b-41eb-846c-e5031791eb96 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:27.949943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b65db-718b-41eb-846c-e5031791eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:27.950210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b65db-718b-41eb-846c-e5031791eb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:27.950975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b65db-718b-41eb-846c-e5031791eb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:27.967970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b65db-718b-41eb-846c-e5031791eb96 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:28.012872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b5ed-0ebe-4e61-8b10-5c8164891594 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:28.016546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1188/2333] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:28.027742 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b5ed-0ebe-4e61-8b10-5c8164891594 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:28.052995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eac39-1d9d-4542-a579-c4baddce9a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:28.054032 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eac39-1d9d-4542-a579-c4baddce9a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:28.054455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eac39-1d9d-4542-a579-c4baddce9a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:28.054839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eac39-1d9d-4542-a579-c4baddce9a83 admin admin] PATH_INFO: `/v3/projects/02d842387a9b49808caf11c84c1763b0/users/e0b1f9a9abdd485d9393dfe556d0f502/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:28.118501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eac39-1d9d-4542-a579-c4baddce9a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d842387a9b49808caf11c84c1763b0, user_id=e0b1f9a9abdd485d9393dfe556d0f502, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:28.121539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eac39-1d9d-4542-a579-c4baddce9a83 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:28.150596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1146/2334] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:28 2022] PUT /identity/v3/projects/02d842387a9b49808caf11c84c1763b0/users/e0b1f9a9abdd485d9393dfe556d0f502/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:28.156357 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b65db-718b-41eb-846c-e5031791eb96 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:28.177024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b65db-718b-41eb-846c-e5031791eb96 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:28.308724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75015f-b663-48a4-bc9b-af1581c8b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:28.310456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75015f-b663-48a4-bc9b-af1581c8b9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:28.310971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75015f-b663-48a4-bc9b-af1581c8b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:28.312735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75015f-b663-48a4-bc9b-af1581c8b9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:28.313726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75015f-b663-48a4-bc9b-af1581c8b9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:28.317667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75015f-b663-48a4-bc9b-af1581c8b9a7 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:28.367368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1189/2335] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:28.368533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eac39-1d9d-4542-a579-c4baddce9a83 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:28.387920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eac39-1d9d-4542-a579-c4baddce9a83 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:28.408028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb442a-8a9e-4819-9a28-e835c1994dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:28.412029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb442a-8a9e-4819-9a28-e835c1994dca admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:28.412352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb442a-8a9e-4819-9a28-e835c1994dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:28.412601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb442a-8a9e-4819-9a28-e835c1994dca admin admin] PATH_INFO: `/v3/projects/02d842387a9b49808caf11c84c1763b0/users/e0b1f9a9abdd485d9393dfe556d0f502/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:28.424271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb442a-8a9e-4819-9a28-e835c1994dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d842387a9b49808caf11c84c1763b0, user_id=e0b1f9a9abdd485d9393dfe556d0f502, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:28.442828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb442a-8a9e-4819-9a28-e835c1994dca admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:28.482711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1147/2336] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:28 2022] PUT /identity/v3/projects/02d842387a9b49808caf11c84c1763b0/users/e0b1f9a9abdd485d9393dfe556d0f502/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:28.901544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d4d8-1c71-4076-b818-6bba230d1208 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:28.902013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d4d8-1c71-4076-b818-6bba230d1208 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:28.902574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d4d8-1c71-4076-b818-6bba230d1208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:28.958888 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e515d4d8-1c71-4076-b818-6bba230d1208 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:28.960934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e515d4d8-1c71-4076-b818-6bba230d1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:29.028199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:29.236309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1190/2337] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:52:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:29.303386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb442a-8a9e-4819-9a28-e835c1994dca admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:29.305251 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-acfb442a-8a9e-4819-9a28-e835c1994dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:29.391616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:29.518549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb442a-8a9e-4819-9a28-e835c1994dca admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:29.527809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af9e8-a36a-4e04-a6d1-27edd5a8a355 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:29.528544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af9e8-a36a-4e04-a6d1-27edd5a8a355 service swift] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:29.529032 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af9e8-a36a-4e04-a6d1-27edd5a8a355 service swift] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:29.529153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af9e8-a36a-4e04-a6d1-27edd5a8a355 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:29.540675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af9e8-a36a-4e04-a6d1-27edd5a8a355 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:29.545450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af9e8-a36a-4e04-a6d1-27edd5a8a355 service swift] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:29.556747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1148/2338] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:52:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 18:52:34.865348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d4d8-1c71-4076-b818-6bba230d1208 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:35.058371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d4d8-1c71-4076-b818-6bba230d1208 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:35.073118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:35.075217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:35.092574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:35.093801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] PATH_INFO: `/v3/users/6ed5aedf7fe64602bd69b8d25a77d320` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:35.101662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed5aedf7fe64602bd69b8d25a77d320)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:35.119950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:35.344437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed5aedf7fe64602bd69b8d25a77d320'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:35.398840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed5aedf7fe64602bd69b8d25a77d320'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:35.398840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed5aedf7fe64602bd69b8d25a77d320'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:35.408038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed5aedf7fe64602bd69b8d25a77d320'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:35.435126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed5aedf7fe64602bd69b8d25a77d320'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:35.447907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1191/2339] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:34 2022] DELETE /identity/v3/users/6ed5aedf7fe64602bd69b8d25a77d320 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:35.450559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b68135-58f7-4c47-a7df-3cd225124541 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:35.452149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b68135-58f7-4c47-a7df-3cd225124541 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:35.453274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b68135-58f7-4c47-a7df-3cd225124541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:35.499644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-30b68135-58f7-4c47-a7df-3cd225124541 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:35.502249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-30b68135-58f7-4c47-a7df-3cd225124541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:35.610982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1149/2340] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:35.628620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:35.630035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:35.707484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:35.813373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f475cd7-6044-43b1-8705-bd473b0b4f12 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:35.823699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d2f4-5742-44a4-8b11-41ceaa29c045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:35.824440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d2f4-5742-44a4-8b11-41ceaa29c045 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:35.824820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d2f4-5742-44a4-8b11-41ceaa29c045 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:35.825106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d2f4-5742-44a4-8b11-41ceaa29c045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:35.840772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98d2f4-5742-44a4-8b11-41ceaa29c045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:35.847755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98d2f4-5742-44a4-8b11-41ceaa29c045 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:35.862153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1192/2341] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:37.076712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff7d4b-fd5d-4250-a8d5-7025eed20671 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:37.077288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff7d4b-fd5d-4250-a8d5-7025eed20671 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:37.077288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff7d4b-fd5d-4250-a8d5-7025eed20671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:37.122888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-cbff7d4b-fd5d-4250-a8d5-7025eed20671 None None] MFA Rules not processed for user `aacb60b92e9346dda3f4e2c43885a883`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:37.124374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-cbff7d4b-fd5d-4250-a8d5-7025eed20671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:37.211408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d2f4-5742-44a4-8b11-41ceaa29c045 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:37.215927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3e98d2f4-5742-44a4-8b11-41ceaa29c045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:37.260965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1150/2342] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:37.269432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d2f4-5742-44a4-8b11-41ceaa29c045 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:37.286931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:37.288125 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:37.288632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:37.289122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] PATH_INFO: `/v3/projects/188b3011c4d44e318a6e0cf27510801a` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:37.290765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] RBAC: Authorizing `identity:delete_project(project_id=188b3011c4d44e318a6e0cf27510801a)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:37.293302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:37.360913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188b3011c4d44e318a6e0cf27510801a', 'request_id': 'req-be21a4a2-2f54-44a9-89e4-752ec0d8757c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:37.381458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188b3011c4d44e318a6e0cf27510801a', 'request_id': 'req-be21a4a2-2f54-44a9-89e4-752ec0d8757c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:37.399394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188b3011c4d44e318a6e0cf27510801a', 'request_id': 'req-be21a4a2-2f54-44a9-89e4-752ec0d8757c'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:37.423628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] The token cache is being invalidate because project 188b3011c4d44e318a6e0cf27510801a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:37.424782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:37.480303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-be21a4a2-2f54-44a9-89e4-752ec0d8757c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:37.491412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1193/2343] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:37 2022] DELETE /identity/v3/projects/188b3011c4d44e318a6e0cf27510801a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:37.491527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482596-4d7c-41ac-9c33-6ae33bacb3cd None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:37.491527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482596-4d7c-41ac-9c33-6ae33bacb3cd None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:37.491527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482596-4d7c-41ac-9c33-6ae33bacb3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:37.730752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-6c482596-4d7c-41ac-9c33-6ae33bacb3cd None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:37.732057 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6c482596-4d7c-41ac-9c33-6ae33bacb3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:37.814742 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:37.887112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1151/2344] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:52:37.895070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3b2f1-10ad-482b-90c1-83a5b1fe9dbb None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:37.895421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3b2f1-10ad-482b-90c1-83a5b1fe9dbb None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:37.895725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3b2f1-10ad-482b-90c1-83a5b1fe9dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:37.942293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-20f3b2f1-10ad-482b-90c1-83a5b1fe9dbb None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:37.943518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-20f3b2f1-10ad-482b-90c1-83a5b1fe9dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:37.967709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1194/2345] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:37.971917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c482596-4d7c-41ac-9c33-6ae33bacb3cd None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:37.986937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c482596-4d7c-41ac-9c33-6ae33bacb3cd None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:37.998827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dbd40-7614-4300-8ad4-79b95d72319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:37.999509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dbd40-7614-4300-8ad4-79b95d72319c admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:37.999791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dbd40-7614-4300-8ad4-79b95d72319c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:38.000063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dbd40-7614-4300-8ad4-79b95d72319c admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:38.000800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dbd40-7614-4300-8ad4-79b95d72319c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:38.001107 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dbd40-7614-4300-8ad4-79b95d72319c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:38.006908 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dbd40-7614-4300-8ad4-79b95d72319c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:38.030770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1152/2346] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:52:38.033262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3b2f1-10ad-482b-90c1-83a5b1fe9dbb None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:38.046002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3b2f1-10ad-482b-90c1-83a5b1fe9dbb None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:38.061300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4698-08f3-4eb3-90f9-0906efef5f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:38.062013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4698-08f3-4eb3-90f9-0906efef5f52 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:38.062300 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4698-08f3-4eb3-90f9-0906efef5f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:38.062639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4698-08f3-4eb3-90f9-0906efef5f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:38.063368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a4698-08f3-4eb3-90f9-0906efef5f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:38.065716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a4698-08f3-4eb3-90f9-0906efef5f52 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:38.132374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1195/2347] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:38 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:38.136539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dbd40-7614-4300-8ad4-79b95d72319c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:38.155740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dbd40-7614-4300-8ad4-79b95d72319c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:38.381567 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab16966-b14b-4713-9f94-e2c1761e807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:38.382294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab16966-b14b-4713-9f94-e2c1761e807e admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:38.382666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab16966-b14b-4713-9f94-e2c1761e807e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:38.382887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab16966-b14b-4713-9f94-e2c1761e807e admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:38.383617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab16966-b14b-4713-9f94-e2c1761e807e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:38.402602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab16966-b14b-4713-9f94-e2c1761e807e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:38.474581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1153/2348] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:38 2022] POST /identity/v3/users => generated 296 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:38.474814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4698-08f3-4eb3-90f9-0906efef5f52 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:38.494783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4698-08f3-4eb3-90f9-0906efef5f52 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:38.503112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ee7db-89a7-4c5b-af05-80a529275662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:38.504515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ee7db-89a7-4c5b-af05-80a529275662 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:38.505937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ee7db-89a7-4c5b-af05-80a529275662 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:38.506320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ee7db-89a7-4c5b-af05-80a529275662 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:38.509858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ee7db-89a7-4c5b-af05-80a529275662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:38.511854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ee7db-89a7-4c5b-af05-80a529275662 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:38.550326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1196/2349] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:38.555033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab16966-b14b-4713-9f94-e2c1761e807e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:38.569606 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab16966-b14b-4713-9f94-e2c1761e807e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:38.576900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ceae5-eca1-47d9-8090-093702d6cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:38.576900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ceae5-eca1-47d9-8090-093702d6cbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:38.576900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ceae5-eca1-47d9-8090-093702d6cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:38.576900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ceae5-eca1-47d9-8090-093702d6cbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:38.577782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ceae5-eca1-47d9-8090-093702d6cbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:38.580089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ceae5-eca1-47d9-8090-093702d6cbf2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:38.620476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ee7db-89a7-4c5b-af05-80a529275662 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:38.621732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1154/2350] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:38.634816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ee7db-89a7-4c5b-af05-80a529275662 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:38.640835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e48e34-01c6-45c0-89ff-a59ca0cccdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:38.642106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e48e34-01c6-45c0-89ff-a59ca0cccdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:38.642662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e48e34-01c6-45c0-89ff-a59ca0cccdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:38.643193 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e48e34-01c6-45c0-89ff-a59ca0cccdcc admin admin] PATH_INFO: `/v3/projects/69fc81c3748a4ca9a3377201a18647b9/users/bb7d971d46134237adf562f12112a364/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:38.698186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e48e34-01c6-45c0-89ff-a59ca0cccdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=69fc81c3748a4ca9a3377201a18647b9, user_id=bb7d971d46134237adf562f12112a364, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:38.707403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e48e34-01c6-45c0-89ff-a59ca0cccdcc admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:38.744255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1197/2351] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:38 2022] PUT /identity/v3/projects/69fc81c3748a4ca9a3377201a18647b9/users/bb7d971d46134237adf562f12112a364/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:52:38.757332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a63d1-c680-4799-9526-52c0372b8f16 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:38.757733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a63d1-c680-4799-9526-52c0372b8f16 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:38.757969 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a63d1-c680-4799-9526-52c0372b8f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:38.864461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a11a63d1-c680-4799-9526-52c0372b8f16 None None] MFA Rules not processed for user `bb7d971d46134237adf562f12112a364`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:38.866350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a11a63d1-c680-4799-9526-52c0372b8f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:39.026351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1155/2352] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:39.036228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e48e34-01c6-45c0-89ff-a59ca0cccdcc admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:39.038295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-06e48e34-01c6-45c0-89ff-a59ca0cccdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:39.192013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:39.248089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e48e34-01c6-45c0-89ff-a59ca0cccdcc admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:39.277986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7c3a6-5851-448b-b6d5-efe5d0023a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:39.279140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7c3a6-5851-448b-b6d5-efe5d0023a5e service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:39.280517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7c3a6-5851-448b-b6d5-efe5d0023a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:39.281139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7c3a6-5851-448b-b6d5-efe5d0023a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:39.308694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7c3a6-5851-448b-b6d5-efe5d0023a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:39.311437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7c3a6-5851-448b-b6d5-efe5d0023a5e service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:39.345108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1198/2353] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:40.133181 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7eadd-3706-4259-a803-2dbf6c6254aa None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:40.133671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7eadd-3706-4259-a803-2dbf6c6254aa None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:40.133934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7eadd-3706-4259-a803-2dbf6c6254aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:40.219396 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-61e7eadd-3706-4259-a803-2dbf6c6254aa None None] MFA Rules not processed for user `e0b1f9a9abdd485d9393dfe556d0f502`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:40.220644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-61e7eadd-3706-4259-a803-2dbf6c6254aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:40.315976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:40.495605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1156/2354] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:40.509915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7c3a6-5851-448b-b6d5-efe5d0023a5e service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:40.517907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-65c7c3a6-5851-448b-b6d5-efe5d0023a5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:40.770188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7c3a6-5851-448b-b6d5-efe5d0023a5e service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:40.786069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739371-7fdf-4d09-b6da-56cd47d03b3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:40.787318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739371-7fdf-4d09-b6da-56cd47d03b3b service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:40.787604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739371-7fdf-4d09-b6da-56cd47d03b3b service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:40.787885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739371-7fdf-4d09-b6da-56cd47d03b3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:40.789781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5d739371-7fdf-4d09-b6da-56cd47d03b3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:40.944786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d739371-7fdf-4d09-b6da-56cd47d03b3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:40.947066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d739371-7fdf-4d09-b6da-56cd47d03b3b service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:40.958890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1199/2355] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:45.075273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf7cdf-5109-40f7-8c36-e18dfe04f944 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:45.075948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf7cdf-5109-40f7-8c36-e18dfe04f944 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:45.075948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf7cdf-5109-40f7-8c36-e18dfe04f944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:45.135051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-fedf7cdf-5109-40f7-8c36-e18dfe04f944 None None] MFA Rules not processed for user `0a5776b5796044f4b8db3b7ffac5940c`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:45.137653 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-fedf7cdf-5109-40f7-8c36-e18dfe04f944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:45.160344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1157/2356] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:50.953856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=66 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:52.415522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739371-7fdf-4d09-b6da-56cd47d03b3b service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:52.487760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739371-7fdf-4d09-b6da-56cd47d03b3b service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:52.492829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:52.493483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:52.493765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:52.494148 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] PATH_INFO: `/v3/users/bb7d971d46134237adf562f12112a364` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:52.495272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7d971d46134237adf562f12112a364)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:52.497202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:52.574299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7d971d46134237adf562f12112a364'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:52.591351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7d971d46134237adf562f12112a364'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:52.592252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7d971d46134237adf562f12112a364'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:52.600221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7d971d46134237adf562f12112a364'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:52.608222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7d971d46134237adf562f12112a364'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:52.615008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1200/2357] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:52 2022] DELETE /identity/v3/users/bb7d971d46134237adf562f12112a364 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:52.619373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a90411-3ce0-4f3a-bc32-8fb64a14528a None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:52.619948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a90411-3ce0-4f3a-bc32-8fb64a14528a None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:52.620048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a90411-3ce0-4f3a-bc32-8fb64a14528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:52.640366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-21a90411-3ce0-4f3a-bc32-8fb64a14528a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:52.641579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-21a90411-3ce0-4f3a-bc32-8fb64a14528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:52.705187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1158/2358] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:52.716827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:52.718928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:52.785056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92de40-97a9-43a9-8ef1-a62ec705e664 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:52.789272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b20c2-ecd1-4008-8cd4-e6dd62e85026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:52.789917 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b20c2-ecd1-4008-8cd4-e6dd62e85026 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:52.790202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b20c2-ecd1-4008-8cd4-e6dd62e85026 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:52.790520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b20c2-ecd1-4008-8cd4-e6dd62e85026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:52.800394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b20c2-ecd1-4008-8cd4-e6dd62e85026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:52.802445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b20c2-ecd1-4008-8cd4-e6dd62e85026 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:52.812386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1201/2359] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:53.286540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a90411-3ce0-4f3a-bc32-8fb64a14528a None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:53.288948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-21a90411-3ce0-4f3a-bc32-8fb64a14528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:53.304788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a90411-3ce0-4f3a-bc32-8fb64a14528a None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:53.310868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:53.312157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.312804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.313627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] PATH_INFO: `/v3/projects/69fc81c3748a4ca9a3377201a18647b9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:53.315076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69fc81c3748a4ca9a3377201a18647b9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:53.317103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:53.387150 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69fc81c3748a4ca9a3377201a18647b9', 'request_id': 'req-12f1e1bb-a8e9-496c-9c48-9087655e1e23'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:53.400926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69fc81c3748a4ca9a3377201a18647b9', 'request_id': 'req-12f1e1bb-a8e9-496c-9c48-9087655e1e23'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:53.407988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69fc81c3748a4ca9a3377201a18647b9', 'request_id': 'req-12f1e1bb-a8e9-496c-9c48-9087655e1e23'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:53.420038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] The token cache is being invalidate because project 69fc81c3748a4ca9a3377201a18647b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:52:53.420271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:53.421078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-12f1e1bb-a8e9-496c-9c48-9087655e1e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:53.423028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1159/2360] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:52:53 2022] DELETE /identity/v3/projects/69fc81c3748a4ca9a3377201a18647b9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:53.427871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583c72-2c86-490d-b816-35fd28f1b64d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.428658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583c72-2c86-490d-b816-35fd28f1b64d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.428658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583c72-2c86-490d-b816-35fd28f1b64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:53.451229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-32583c72-2c86-490d-b816-35fd28f1b64d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:53.452627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-32583c72-2c86-490d-b816-35fd28f1b64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:53.472429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:53.527028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1202/2361] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:53.538800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238480-7917-44cc-b7d8-2dd2ad533608 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.539096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238480-7917-44cc-b7d8-2dd2ad533608 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.539387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238480-7917-44cc-b7d8-2dd2ad533608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:53.561755 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ff238480-7917-44cc-b7d8-2dd2ad533608 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:53.563323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ff238480-7917-44cc-b7d8-2dd2ad533608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:53.577400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1160/2362] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:53.579303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32583c72-2c86-490d-b816-35fd28f1b64d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:53.599081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32583c72-2c86-490d-b816-35fd28f1b64d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:53.604053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d892f7-e498-4814-ba7f-092aafbc8b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:53.604746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d892f7-e498-4814-ba7f-092aafbc8b7a admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.605001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d892f7-e498-4814-ba7f-092aafbc8b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.605277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d892f7-e498-4814-ba7f-092aafbc8b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:53.606019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d892f7-e498-4814-ba7f-092aafbc8b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:52:53.606331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d892f7-e498-4814-ba7f-092aafbc8b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:53.608068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d892f7-e498-4814-ba7f-092aafbc8b7a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:53.621557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1203/2363] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:52:53.625591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff238480-7917-44cc-b7d8-2dd2ad533608 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:53.636617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff238480-7917-44cc-b7d8-2dd2ad533608 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:53.651652 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d1f1b-11e3-40d1-a691-fd2d4234b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:53.652637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d1f1b-11e3-40d1-a691-fd2d4234b6ba admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.653078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d1f1b-11e3-40d1-a691-fd2d4234b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.653470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d1f1b-11e3-40d1-a691-fd2d4234b6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:53.654447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d1f1b-11e3-40d1-a691-fd2d4234b6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:53.657311 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d1f1b-11e3-40d1-a691-fd2d4234b6ba admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:53.696763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1161/2364] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:52:53 2022] POST /identity/v3/projects => generated 397 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:53.701332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d892f7-e498-4814-ba7f-092aafbc8b7a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:53.712633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d892f7-e498-4814-ba7f-092aafbc8b7a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:53.787793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b92900-a767-4317-96b6-2f2e15017a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:53.788570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b92900-a767-4317-96b6-2f2e15017a58 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.788923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b92900-a767-4317-96b6-2f2e15017a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.789279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b92900-a767-4317-96b6-2f2e15017a58 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:53.790070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b92900-a767-4317-96b6-2f2e15017a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:53.792587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b92900-a767-4317-96b6-2f2e15017a58 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:53.826409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1204/2365] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:52:53 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:52:53.830581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d1f1b-11e3-40d1-a691-fd2d4234b6ba admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:53.837187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:53.844045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d1f1b-11e3-40d1-a691-fd2d4234b6ba admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:53.851227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b893631-b239-43cd-a39d-b7c05fa4a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:53.851991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b893631-b239-43cd-a39d-b7c05fa4a842 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.852718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b893631-b239-43cd-a39d-b7c05fa4a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.853208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b893631-b239-43cd-a39d-b7c05fa4a842 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:53.854434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b893631-b239-43cd-a39d-b7c05fa4a842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:53.856291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b893631-b239-43cd-a39d-b7c05fa4a842 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:53.872055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1162/2366] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:52:53.876716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b92900-a767-4317-96b6-2f2e15017a58 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:53.888333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b92900-a767-4317-96b6-2f2e15017a58 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:53.893057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e8302-45cd-4a73-a709-cf4b3864a406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:53.893724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e8302-45cd-4a73-a709-cf4b3864a406 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.894012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e8302-45cd-4a73-a709-cf4b3864a406 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.894289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e8302-45cd-4a73-a709-cf4b3864a406 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:53.895139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e8302-45cd-4a73-a709-cf4b3864a406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:53.896736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e8302-45cd-4a73-a709-cf4b3864a406 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:53.909878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1205/2367] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:52:53.916421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b893631-b239-43cd-a39d-b7c05fa4a842 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:53.933644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b893631-b239-43cd-a39d-b7c05fa4a842 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:53.938444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e34bae-a00c-48e6-bb32-27002f0893ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:53.939352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e34bae-a00c-48e6-bb32-27002f0893ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.939631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e34bae-a00c-48e6-bb32-27002f0893ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.939916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e34bae-a00c-48e6-bb32-27002f0893ad admin admin] PATH_INFO: `/v3/projects/052038d6876d4eb88c38c5b7f2e8630e/users/bc962d4e80134fb480f35935084f0a85/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:53.958995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e34bae-a00c-48e6-bb32-27002f0893ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=052038d6876d4eb88c38c5b7f2e8630e, user_id=bc962d4e80134fb480f35935084f0a85, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:53.962068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e34bae-a00c-48e6-bb32-27002f0893ad admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:53.978886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1163/2368] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:52:53 2022] PUT /identity/v3/projects/052038d6876d4eb88c38c5b7f2e8630e/users/bc962d4e80134fb480f35935084f0a85/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:52:53.990320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75883-1f03-4915-864f-264b0fcfe0b9 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:53.990651 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75883-1f03-4915-864f-264b0fcfe0b9 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:53.990927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e75883-1f03-4915-864f-264b0fcfe0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.017964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-b8e75883-1f03-4915-864f-264b0fcfe0b9 None None] MFA Rules not processed for user `bc962d4e80134fb480f35935084f0a85`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:54.019208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b8e75883-1f03-4915-864f-264b0fcfe0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:54.092711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1206/2369] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:54.107261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e34bae-a00c-48e6-bb32-27002f0893ad admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:54.109035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a8e34bae-a00c-48e6-bb32-27002f0893ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:54.195534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e34bae-a00c-48e6-bb32-27002f0893ad admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:54.199964 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69cf08-73fd-452f-8de4-b3ccfe1a9886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:54.200660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69cf08-73fd-452f-8de4-b3ccfe1a9886 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:54.200949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69cf08-73fd-452f-8de4-b3ccfe1a9886 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:54.201232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69cf08-73fd-452f-8de4-b3ccfe1a9886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:54.211301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69cf08-73fd-452f-8de4-b3ccfe1a9886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:54.213028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69cf08-73fd-452f-8de4-b3ccfe1a9886 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:54.228328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1164/2370] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:52:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:57.437243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbc3c0-8e9c-4a2e-883c-bb00b1b66c39 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:57.438087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbc3c0-8e9c-4a2e-883c-bb00b1b66c39 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:57.438087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbc3c0-8e9c-4a2e-883c-bb00b1b66c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:57.483086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-dfdbc3c0-8e9c-4a2e-883c-bb00b1b66c39 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:57.484290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dfdbc3c0-8e9c-4a2e-883c-bb00b1b66c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:57.491808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:57.588059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1207/2371] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:57.602002 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69cf08-73fd-452f-8de4-b3ccfe1a9886 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:57.605437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6d69cf08-73fd-452f-8de4-b3ccfe1a9886 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:57.699049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69cf08-73fd-452f-8de4-b3ccfe1a9886 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:57.706256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd80f4-3407-408d-a362-d4e02010d0f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:57.707011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd80f4-3407-408d-a362-d4e02010d0f8 service swift] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:57.708043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd80f4-3407-408d-a362-d4e02010d0f8 service swift] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:57.708341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd80f4-3407-408d-a362-d4e02010d0f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:57.719539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd80f4-3407-408d-a362-d4e02010d0f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:57.721386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd80f4-3407-408d-a362-d4e02010d0f8 service swift] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:57.732308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1165/2372] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:52:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:52:58.325847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c61ce-4853-421b-a3b5-790f21ad3c2e None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:58.326350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c61ce-4853-421b-a3b5-790f21ad3c2e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:58.326688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c61ce-4853-421b-a3b5-790f21ad3c2e None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:58.329126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1208/2373] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:52:58.336315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9d70-55be-43f4-af1a-fbf9c24b4bc6 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:58.336954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9d70-55be-43f4-af1a-fbf9c24b4bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:58.337415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd9d70-55be-43f4-af1a-fbf9c24b4bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:58.400350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-28dd9d70-55be-43f4-af1a-fbf9c24b4bc6 None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:52:58.403369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-28dd9d70-55be-43f4-af1a-fbf9c24b4bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:52:58.416062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:58.553468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1166/2374] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:52:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:52:59.679200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c61ce-4853-421b-a3b5-790f21ad3c2e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:52:59.820263 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c61ce-4853-421b-a3b5-790f21ad3c2e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:52:59.827475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:52:59.829003 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:52:59.829554 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:52:59.830052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] PATH_INFO: `/v3/users/bc962d4e80134fb480f35935084f0a85` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:52:59.832154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc962d4e80134fb480f35935084f0a85)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:52:59.838895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:52:59.930626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc962d4e80134fb480f35935084f0a85'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:59.955140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc962d4e80134fb480f35935084f0a85'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:59.956319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc962d4e80134fb480f35935084f0a85'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:59.969214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc962d4e80134fb480f35935084f0a85'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:59.986139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc962d4e80134fb480f35935084f0a85'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:52:59.996878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1209/2375] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:52:59 2022] DELETE /identity/v3/users/bc962d4e80134fb480f35935084f0a85 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:53:00.001779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cf0e8-01bc-48b5-862a-e0878c58d6f0 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:00.002455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cf0e8-01bc-48b5-862a-e0878c58d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:00.002455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cf0e8-01bc-48b5-862a-e0878c58d6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:00.038482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-588cf0e8-01bc-48b5-862a-e0878c58d6f0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:00.039745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-588cf0e8-01bc-48b5-862a-e0878c58d6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:00.172435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1167/2376] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:00.183374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:00.185185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:00.229786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:00.275182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e920f-32f8-4c1b-ba79-ce0acccf81d2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:00.281261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425d64a-d066-41ba-bb21-0c46a06bc452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:00.282311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425d64a-d066-41ba-bb21-0c46a06bc452 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:00.282728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425d64a-d066-41ba-bb21-0c46a06bc452 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:00.283023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425d64a-d066-41ba-bb21-0c46a06bc452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:00.299616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425d64a-d066-41ba-bb21-0c46a06bc452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:00.304043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425d64a-d066-41ba-bb21-0c46a06bc452 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:00.323997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1210/2377] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:00.735634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cf0e8-01bc-48b5-862a-e0878c58d6f0 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:00.737607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-588cf0e8-01bc-48b5-862a-e0878c58d6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:00.765138 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cf0e8-01bc-48b5-862a-e0878c58d6f0 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:00.773718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:00.775400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:00.775802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:00.776181 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] PATH_INFO: `/v3/projects/052038d6876d4eb88c38c5b7f2e8630e` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:00.777769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=052038d6876d4eb88c38c5b7f2e8630e)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:00.782160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:00.890822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052038d6876d4eb88c38c5b7f2e8630e', 'request_id': 'req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:00.902205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052038d6876d4eb88c38c5b7f2e8630e', 'request_id': 'req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:00.913353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052038d6876d4eb88c38c5b7f2e8630e', 'request_id': 'req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:00.932734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] The token cache is being invalidate because project 052038d6876d4eb88c38c5b7f2e8630e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:53:00.933134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:00.933900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-982f29d5-00c7-4fc7-88a3-cc4c3839cd98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:00.958012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1168/2378] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:53:00 2022] DELETE /identity/v3/projects/052038d6876d4eb88c38c5b7f2e8630e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:53:10.314680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=14 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:10.876061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425d64a-d066-41ba-bb21-0c46a06bc452 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:10.877764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4425d64a-d066-41ba-bb21-0c46a06bc452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:10.926061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:10.958874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425d64a-d066-41ba-bb21-0c46a06bc452 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:11.009133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7bebc-bb7e-45d5-88f9-d4bca177b14e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb359ac9b084b38b77923219f42f655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:11.009835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7bebc-bb7e-45d5-88f9-d4bca177b14e service glance] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:11.010117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7bebc-bb7e-45d5-88f9-d4bca177b14e service glance] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:11.010441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7bebc-bb7e-45d5-88f9-d4bca177b14e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:11.012372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-83f7bebc-bb7e-45d5-88f9-d4bca177b14e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:11.103849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7bebc-bb7e-45d5-88f9-d4bca177b14e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:11.105505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7bebc-bb7e-45d5-88f9-d4bca177b14e service glance] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:11.118932 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1211/2379] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:11.205860 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40254579-536d-43fc-89db-5c66ca9f62af None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:11.206244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40254579-536d-43fc-89db-5c66ca9f62af None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:11.207153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40254579-536d-43fc-89db-5c66ca9f62af None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:11.208730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1169/2380] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:53:11.215626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94540c-ad0d-446f-93ba-03985d21e7b0 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:11.216429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94540c-ad0d-446f-93ba-03985d21e7b0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:11.216964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94540c-ad0d-446f-93ba-03985d21e7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:11.240276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4a94540c-ad0d-446f-93ba-03985d21e7b0 None None] MFA Rules not processed for user `e11a8567e1254a0080cbe74efe0127f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:11.241507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4a94540c-ad0d-446f-93ba-03985d21e7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:11.276787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:11.299563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1212/2381] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:53:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:53:11.312798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40254579-536d-43fc-89db-5c66ca9f62af None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:11.314601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-40254579-536d-43fc-89db-5c66ca9f62af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:11.328804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40254579-536d-43fc-89db-5c66ca9f62af None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:11.333423 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc2002-29c7-464b-91b9-7eeb712c6f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:11.334229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2002-29c7-464b-91b9-7eeb712c6f82 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:11.334537 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2002-29c7-464b-91b9-7eeb712c6f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:11.334904 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2002-29c7-464b-91b9-7eeb712c6f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:11.343301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc2002-29c7-464b-91b9-7eeb712c6f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:11.347373 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc2002-29c7-464b-91b9-7eeb712c6f82 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:11.356635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1170/2382] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:11.442912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0cc3c-2fad-4492-b72b-f465e3cff72d None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:11.443430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0cc3c-2fad-4492-b72b-f465e3cff72d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:11.443430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0cc3c-2fad-4492-b72b-f465e3cff72d None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:11.444821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1213/2383] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:53:11.450322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47528cfd-3222-450e-be27-1efe98b1d73b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:11.450639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47528cfd-3222-450e-be27-1efe98b1d73b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:11.450917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47528cfd-3222-450e-be27-1efe98b1d73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:11.473408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-47528cfd-3222-450e-be27-1efe98b1d73b None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:11.475569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-47528cfd-3222-450e-be27-1efe98b1d73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:11.487738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1171/2384] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:53:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:11.501309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0cc3c-2fad-4492-b72b-f465e3cff72d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:11.514239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0cc3c-2fad-4492-b72b-f465e3cff72d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:11.517850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bff7d-c7f0-4149-b1f9-100dd67f9622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:11.518524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bff7d-c7f0-4149-b1f9-100dd67f9622 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:11.518901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bff7d-c7f0-4149-b1f9-100dd67f9622 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:11.519096 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bff7d-c7f0-4149-b1f9-100dd67f9622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:11.529547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bff7d-c7f0-4149-b1f9-100dd67f9622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:11.531003 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bff7d-c7f0-4149-b1f9-100dd67f9622 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:11.542202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1214/2385] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:14.650347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c375b-db34-44d3-928d-29e8116e46ba None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:14.651293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c375b-db34-44d3-928d-29e8116e46ba None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:14.651577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c375b-db34-44d3-928d-29e8116e46ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:14.736871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d98c375b-db34-44d3-928d-29e8116e46ba None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:14.739372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d98c375b-db34-44d3-928d-29e8116e46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:14.857217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1172/2386] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:53:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:14.888265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bff7d-c7f0-4149-b1f9-100dd67f9622 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:14.890642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c38bff7d-c7f0-4149-b1f9-100dd67f9622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:15.087955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bff7d-c7f0-4149-b1f9-100dd67f9622 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:15.095058 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faf141-ecc9-430e-ac89-43bf8fd14ed7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:15.095731 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faf141-ecc9-430e-ac89-43bf8fd14ed7 service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:15.096017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faf141-ecc9-430e-ac89-43bf8fd14ed7 service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:15.096294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faf141-ecc9-430e-ac89-43bf8fd14ed7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:15.109698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faf141-ecc9-430e-ac89-43bf8fd14ed7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:15.111254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faf141-ecc9-430e-ac89-43bf8fd14ed7 service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:15.124711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1215/2387] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:53:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:53:24.025040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bb980-42f6-4e92-8034-9793f42c0c43 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:24.025974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bb980-42f6-4e92-8034-9793f42c0c43 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:24.026596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bb980-42f6-4e92-8034-9793f42c0c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:24.044942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-171bb980-42f6-4e92-8034-9793f42c0c43 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:24.046155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-171bb980-42f6-4e92-8034-9793f42c0c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:24.054144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1173/2388] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jun 16 18:53:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:24.070416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faf141-ecc9-430e-ac89-43bf8fd14ed7 service swift] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:24.081606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faf141-ecc9-430e-ac89-43bf8fd14ed7 service swift] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:24.086798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac49c6-8c66-425a-9f54-6b82fd834201 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:24.087466 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac49c6-8c66-425a-9f54-6b82fd834201 service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:24.087902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac49c6-8c66-425a-9f54-6b82fd834201 service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:24.088186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac49c6-8c66-425a-9f54-6b82fd834201 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:24.097545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac49c6-8c66-425a-9f54-6b82fd834201 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:24.099395 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac49c6-8c66-425a-9f54-6b82fd834201 service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:24.108840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1216/2389] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:53:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:53:26.417086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bb980-42f6-4e92-8034-9793f42c0c43 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:26.418859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-171bb980-42f6-4e92-8034-9793f42c0c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:26.492739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bb980-42f6-4e92-8034-9793f42c0c43 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:26.497894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:26.498280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:26.498608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:26.498880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] PATH_INFO: `/v3/users/f6525af49ffc42269f0883827ccf7e10` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:26.500126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6525af49ffc42269f0883827ccf7e10)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:26.502079 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:26.557980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6525af49ffc42269f0883827ccf7e10'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.559114 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:26.571569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6525af49ffc42269f0883827ccf7e10'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.572260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6525af49ffc42269f0883827ccf7e10'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.579134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6525af49ffc42269f0883827ccf7e10'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.587067 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6525af49ffc42269f0883827ccf7e10'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.592889 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1174/2390] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:53:26 2022] DELETE /identity/v3/users/f6525af49ffc42269f0883827ccf7e10 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:53:26.780851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac49c6-8c66-425a-9f54-6b82fd834201 service swift] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:26.803630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac49c6-8c66-425a-9f54-6b82fd834201 service swift] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:26.865216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:26.866081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:26.866367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:26.866686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] PATH_INFO: `/v3/projects/e1e8c52f07334beeb35c5aef0b2c56d6` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:26.867882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e8c52f07334beeb35c5aef0b2c56d6)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:26.869791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:26.904294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:26.916938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e8c52f07334beeb35c5aef0b2c56d6', 'request_id': 'req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.923359 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e8c52f07334beeb35c5aef0b2c56d6', 'request_id': 'req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.931197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e8c52f07334beeb35c5aef0b2c56d6', 'request_id': 'req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.941568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] The token cache is being invalidate because project e1e8c52f07334beeb35c5aef0b2c56d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:53:26.941853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.942516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-b7f9d12c-7308-4ad1-a1c3-810830ea85b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:53:26.944064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1217/2391] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:53:26 2022] DELETE /identity/v3/projects/e1e8c52f07334beeb35c5aef0b2c56d6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:53:29.114218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:29.115692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:29.235165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0fbfa-518a-4a6e-ae03-944c9366e900 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:29.312657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:29.313299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:29.313574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:29.313973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:29.316301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:29.329877 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:29.332175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:29.344993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1175/2392] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:30.017846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69db51-1cb6-4f2f-be7f-b62217b9ac98 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:30.019023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69db51-1cb6-4f2f-be7f-b62217b9ac98 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:30.019023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69db51-1cb6-4f2f-be7f-b62217b9ac98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:30.042603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5a69db51-1cb6-4f2f-be7f-b62217b9ac98 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:30.043819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5a69db51-1cb6-4f2f-be7f-b62217b9ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:30.114348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1218/2393] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:30.131090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:30.132670 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:30.175063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:30.207351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8d8d2-0de0-4d19-8aca-f25998d59a53 service placement] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:30.212782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e33a0-b137-4f33-a425-1f0daf87188b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:30.213433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e33a0-b137-4f33-a425-1f0daf87188b service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:30.213713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e33a0-b137-4f33-a425-1f0daf87188b service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:30.213988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e33a0-b137-4f33-a425-1f0daf87188b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:30.224212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e33a0-b137-4f33-a425-1f0daf87188b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:30.225941 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e33a0-b137-4f33-a425-1f0daf87188b service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:30.237099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1176/2394] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:33.017999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b11c1-d145-4cdc-ac84-e0a788e8a784 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:33.019013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b11c1-d145-4cdc-ac84-e0a788e8a784 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:33.019297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b11c1-d145-4cdc-ac84-e0a788e8a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:33.038929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1b6b11c1-d145-4cdc-ac84-e0a788e8a784 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:33.040331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1b6b11c1-d145-4cdc-ac84-e0a788e8a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:33.050430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1219/2395] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:53:33.081624 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e33a0-b137-4f33-a425-1f0daf87188b service nova] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:33.092568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e33a0-b137-4f33-a425-1f0daf87188b service nova] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:33.098496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08c34-7bcb-4ac9-8c59-73a83b99270d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:33.099173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08c34-7bcb-4ac9-8c59-73a83b99270d service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:33.099586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08c34-7bcb-4ac9-8c59-73a83b99270d service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:33.099869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08c34-7bcb-4ac9-8c59-73a83b99270d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:33.109484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08c34-7bcb-4ac9-8c59-73a83b99270d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:33.111285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08c34-7bcb-4ac9-8c59-73a83b99270d service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:33.122040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1177/2396] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:53:38.335094 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b936d-4ff7-41f0-8b2c-3a7e2eb1fd81 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:38.335646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b936d-4ff7-41f0-8b2c-3a7e2eb1fd81 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:38.335646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b936d-4ff7-41f0-8b2c-3a7e2eb1fd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:38.354313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-179b936d-4ff7-41f0-8b2c-3a7e2eb1fd81 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:38.355553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-179b936d-4ff7-41f0-8b2c-3a7e2eb1fd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:38.364580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1220/2397] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:38.383491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08c34-7bcb-4ac9-8c59-73a83b99270d service nova] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:38.395797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08c34-7bcb-4ac9-8c59-73a83b99270d service nova] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:38.401732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fc923-5bbb-4875-a54a-96647353576a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:38.402427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fc923-5bbb-4875-a54a-96647353576a service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:38.402719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fc923-5bbb-4875-a54a-96647353576a service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:38.403003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fc923-5bbb-4875-a54a-96647353576a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:38.412327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fc923-5bbb-4875-a54a-96647353576a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:38.413949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fc923-5bbb-4875-a54a-96647353576a service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:38.425564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1178/2398] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:39.163953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcb3e5-57b3-4f1b-8bf6-47f6960222b2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:39.164081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcb3e5-57b3-4f1b-8bf6-47f6960222b2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:39.164304 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcb3e5-57b3-4f1b-8bf6-47f6960222b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:39.183450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-59dcb3e5-57b3-4f1b-8bf6-47f6960222b2 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:39.184679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-59dcb3e5-57b3-4f1b-8bf6-47f6960222b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:39.248143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1221/2399] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jun 16 18:53:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:39.270481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fc923-5bbb-4875-a54a-96647353576a service nova] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:39.271943 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b42fc923-5bbb-4875-a54a-96647353576a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:39.343355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fc923-5bbb-4875-a54a-96647353576a service nova] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:39.349315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e197-297e-44c6-830c-6fadd609dbe6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:39.350055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e197-297e-44c6-830c-6fadd609dbe6 service swift] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:39.350434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e197-297e-44c6-830c-6fadd609dbe6 service swift] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:39.350779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e197-297e-44c6-830c-6fadd609dbe6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:39.359915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e197-297e-44c6-830c-6fadd609dbe6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:39.362136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070e197-297e-44c6-830c-6fadd609dbe6 service swift] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:39.370645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1179/2400] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:53:43.474324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1017-9a1a-41ea-9b68-ab683895c858 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:43.474858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1017-9a1a-41ea-9b68-ab683895c858 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:43.474969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b1017-9a1a-41ea-9b68-ab683895c858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:43.493565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-014b1017-9a1a-41ea-9b68-ab683895c858 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:43.494817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-014b1017-9a1a-41ea-9b68-ab683895c858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:43.503653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1222/2401] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:43.526399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e197-297e-44c6-830c-6fadd609dbe6 service swift] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:43.539459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e197-297e-44c6-830c-6fadd609dbe6 service swift] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:43.545152 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712e1f5-2cc8-41cf-ad74-5f16aa94fee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:43.545791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712e1f5-2cc8-41cf-ad74-5f16aa94fee7 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:43.546225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712e1f5-2cc8-41cf-ad74-5f16aa94fee7 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:43.546539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712e1f5-2cc8-41cf-ad74-5f16aa94fee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:43.555874 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712e1f5-2cc8-41cf-ad74-5f16aa94fee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:43.557482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712e1f5-2cc8-41cf-ad74-5f16aa94fee7 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:43.567935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1180/2402] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:45.234626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1017-9a1a-41ea-9b68-ab683895c858 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:45.236053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-014b1017-9a1a-41ea-9b68-ab683895c858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:45.289591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:45.296634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b1017-9a1a-41ea-9b68-ab683895c858 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:45.302014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:45.302701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:45.302983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:45.303257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:45.305049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:45.390529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:45.393340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:45.405835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1223/2403] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:47.699206 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011815-79f9-4693-ae68-94fdacc20648 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:47.699783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011815-79f9-4693-ae68-94fdacc20648 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:47.699783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011815-79f9-4693-ae68-94fdacc20648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:47.721242 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-18011815-79f9-4693-ae68-94fdacc20648 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:47.722894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-18011815-79f9-4693-ae68-94fdacc20648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:47.731981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1181/2404] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:47.759972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:47.763169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:47.793547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9937800-62ac-4326-b09a-03a0e25e9870 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:47.801264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0654dd-9509-452d-9024-54d7e25be990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:47.802260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0654dd-9509-452d-9024-54d7e25be990 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:47.802718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0654dd-9509-452d-9024-54d7e25be990 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:47.803149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0654dd-9509-452d-9024-54d7e25be990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:47.813283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0654dd-9509-452d-9024-54d7e25be990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:47.814974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0654dd-9509-452d-9024-54d7e25be990 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:47.826938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1224/2405] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:53:50.832506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28122116-657a-45b8-9043-55a3b9f8e691 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:50.833073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28122116-657a-45b8-9043-55a3b9f8e691 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:50.833073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28122116-657a-45b8-9043-55a3b9f8e691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:50.852123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-28122116-657a-45b8-9043-55a3b9f8e691 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:53:50.853326 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-28122116-657a-45b8-9043-55a3b9f8e691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:53:50.862207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1182/2406] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:53:50.879794 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0654dd-9509-452d-9024-54d7e25be990 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:53:50.890879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0654dd-9509-452d-9024-54d7e25be990 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:53:50.896966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b78d1-7c64-48a6-aea9-66f500171f4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:53:50.897612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b78d1-7c64-48a6-aea9-66f500171f4e service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:53:50.897891 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b78d1-7c64-48a6-aea9-66f500171f4e service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:53:50.898163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b78d1-7c64-48a6-aea9-66f500171f4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:53:50.906735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b78d1-7c64-48a6-aea9-66f500171f4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:53:50.908852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b78d1-7c64-48a6-aea9-66f500171f4e service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:53:50.918884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1225/2407] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:54:00.846986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=73 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:00.914309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=41 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:07.219539 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e6135-c65a-472c-b439-209ae01c6853 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:07.220094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e6135-c65a-472c-b439-209ae01c6853 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:07.220214 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e6135-c65a-472c-b439-209ae01c6853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:07.237839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e92e6135-c65a-472c-b439-209ae01c6853 None None] MFA Rules not processed for user `88ee39a37f564732a7a5774a40cfedff`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:07.239072 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e92e6135-c65a-472c-b439-209ae01c6853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:07.294951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1183/2408] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:54:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:17.287906 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=25 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:23.432194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bee65-3230-4b53-b9da-87086454cc8f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:23.432723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bee65-3230-4b53-b9da-87086454cc8f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:23.432723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bee65-3230-4b53-b9da-87086454cc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:23.451224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e83bee65-3230-4b53-b9da-87086454cc8f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:23.452431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e83bee65-3230-4b53-b9da-87086454cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:23.461277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1226/2409] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:23.492582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e6135-c65a-472c-b439-209ae01c6853 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:54:23.506814 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e6135-c65a-472c-b439-209ae01c6853 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:54:23.512763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0fe06-daa8-4e50-a7a3-bc8b7d331531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:54:23.513438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0fe06-daa8-4e50-a7a3-bc8b7d331531 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:23.513723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0fe06-daa8-4e50-a7a3-bc8b7d331531 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:23.514004 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0fe06-daa8-4e50-a7a3-bc8b7d331531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:23.523602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0fe06-daa8-4e50-a7a3-bc8b7d331531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:54:23.525235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0fe06-daa8-4e50-a7a3-bc8b7d331531 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:54:23.535703 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1184/2410] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:54:25.940698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd9d5-2401-4c34-95e4-1cce701a124d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:25.941194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd9d5-2401-4c34-95e4-1cce701a124d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:25.941289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd9d5-2401-4c34-95e4-1cce701a124d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:25.959653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-bcefd9d5-2401-4c34-95e4-1cce701a124d None None] MFA Rules not processed for user `aacb60b92e9346dda3f4e2c43885a883`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:25.960862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bcefd9d5-2401-4c34-95e4-1cce701a124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:26.020546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1227/2411] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:54:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:27.780226 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17e3ac-4029-4033-9a16-f361038555cc None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:27.780845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17e3ac-4029-4033-9a16-f361038555cc None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:27.781271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17e3ac-4029-4033-9a16-f361038555cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:27.800690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-1a17e3ac-4029-4033-9a16-f361038555cc None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:27.801880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1a17e3ac-4029-4033-9a16-f361038555cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:27.809716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1185/2412] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:27.824224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefd9d5-2401-4c34-95e4-1cce701a124d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:54:27.837029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefd9d5-2401-4c34-95e4-1cce701a124d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:54:27.843063 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b90534-f53c-43ba-9524-1c44130f185e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:54:27.843714 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b90534-f53c-43ba-9524-1c44130f185e service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:27.843997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b90534-f53c-43ba-9524-1c44130f185e service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:27.844273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b90534-f53c-43ba-9524-1c44130f185e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:27.853764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b90534-f53c-43ba-9524-1c44130f185e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:54:27.855760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b90534-f53c-43ba-9524-1c44130f185e service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:54:27.867653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1228/2413] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:54:31.848143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630bcce-5cb9-49b1-b139-de9bbfe411bc None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:31.848709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630bcce-5cb9-49b1-b139-de9bbfe411bc None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:31.848709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630bcce-5cb9-49b1-b139-de9bbfe411bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:31.868948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e630bcce-5cb9-49b1-b139-de9bbfe411bc None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:31.870337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e630bcce-5cb9-49b1-b139-de9bbfe411bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:31.880273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1186/2414] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:31.896774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b90534-f53c-43ba-9524-1c44130f185e service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:54:31.908895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b90534-f53c-43ba-9524-1c44130f185e service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:54:31.915350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa2d48-913c-415d-bb0b-bd379b8794f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:54:31.916023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2d48-913c-415d-bb0b-bd379b8794f8 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:31.916314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2d48-913c-415d-bb0b-bd379b8794f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:31.916595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2d48-913c-415d-bb0b-bd379b8794f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:31.925730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa2d48-913c-415d-bb0b-bd379b8794f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:54:31.927594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa2d48-913c-415d-bb0b-bd379b8794f8 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:54:31.938944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1229/2415] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:54:37.074020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739175b-de00-4f19-88aa-dc8867fc7af6 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:37.074020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739175b-de00-4f19-88aa-dc8867fc7af6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:37.074714 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739175b-de00-4f19-88aa-dc8867fc7af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:37.098697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-6739175b-de00-4f19-88aa-dc8867fc7af6 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:37.100433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6739175b-de00-4f19-88aa-dc8867fc7af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:37.111838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1187/2416] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:37.133813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa2d48-913c-415d-bb0b-bd379b8794f8 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:54:37.146946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa2d48-913c-415d-bb0b-bd379b8794f8 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:54:37.152754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb3ea8-949a-4b1c-a31e-4f6e1855cdef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:54:37.153419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb3ea8-949a-4b1c-a31e-4f6e1855cdef service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:37.153707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb3ea8-949a-4b1c-a31e-4f6e1855cdef service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:37.153985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb3ea8-949a-4b1c-a31e-4f6e1855cdef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:37.164882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb3ea8-949a-4b1c-a31e-4f6e1855cdef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:54:37.166444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb3ea8-949a-4b1c-a31e-4f6e1855cdef service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:54:37.177065 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1230/2417] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:54:38.004390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541b36c-4ad0-4375-acff-24b07391fbee None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:38.004682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541b36c-4ad0-4375-acff-24b07391fbee None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:38.004961 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541b36c-4ad0-4375-acff-24b07391fbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:38.023505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2541b36c-4ad0-4375-acff-24b07391fbee None None] MFA Rules not processed for user `c4dfdeb737d149d881bc9cbd9116cd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:38.024716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2541b36c-4ad0-4375-acff-24b07391fbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:38.087882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1188/2418] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:54:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:40.253836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761549f-ac3d-40cf-b75e-0693c6e03037 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:40.253836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761549f-ac3d-40cf-b75e-0693c6e03037 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:40.253836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761549f-ac3d-40cf-b75e-0693c6e03037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:40.276024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1761549f-ac3d-40cf-b75e-0693c6e03037 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:40.277237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1761549f-ac3d-40cf-b75e-0693c6e03037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:40.285254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1231/2419] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Jun 16 18:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:54:40.301642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541b36c-4ad0-4375-acff-24b07391fbee None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:54:40.317724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541b36c-4ad0-4375-acff-24b07391fbee None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:54:40.323255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36af7-6a09-45ce-90ce-8e928768a146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:54:40.323906 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36af7-6a09-45ce-90ce-8e928768a146 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:40.324186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36af7-6a09-45ce-90ce-8e928768a146 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:40.324461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36af7-6a09-45ce-90ce-8e928768a146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:40.333808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f36af7-6a09-45ce-90ce-8e928768a146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:54:40.335430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f36af7-6a09-45ce-90ce-8e928768a146 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:54:40.345187 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1189/2420] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:54:50.270527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=49 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:50.340668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=46 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:55.860145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50485bc-647d-4107-bcdb-7406100671bd None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:54:55.861159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50485bc-647d-4107-bcdb-7406100671bd None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:54:55.861852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50485bc-647d-4107-bcdb-7406100671bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:54:55.895647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d50485bc-647d-4107-bcdb-7406100671bd None None] MFA Rules not processed for user `d3b7491e67544485bc964386ed5946bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:54:55.901307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d50485bc-647d-4107-bcdb-7406100671bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:54:55.995506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1232/2421] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:54:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:05.981662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=25 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:10.757658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36af7-6a09-45ce-90ce-8e928768a146 service nova] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:10.759225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b0f36af7-6a09-45ce-90ce-8e928768a146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:10.773272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36af7-6a09-45ce-90ce-8e928768a146 service nova] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:10.778176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:10.779267 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:10.779548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:10.779821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] PATH_INFO: `/v3/users/88ee39a37f564732a7a5774a40cfedff` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:10.781047 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ee39a37f564732a7a5774a40cfedff)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:10.783011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:10.830447 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ee39a37f564732a7a5774a40cfedff'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:10.843911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ee39a37f564732a7a5774a40cfedff'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:10.844604 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ee39a37f564732a7a5774a40cfedff'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:10.851796 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ee39a37f564732a7a5774a40cfedff'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:10.859113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ee39a37f564732a7a5774a40cfedff'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:10.865119 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1190/2422] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:55:10 2022] DELETE /identity/v3/users/88ee39a37f564732a7a5774a40cfedff => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:11.039096 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50485bc-647d-4107-bcdb-7406100671bd None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:11.051711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50485bc-647d-4107-bcdb-7406100671bd None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:11.111807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:11.112663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:11.112944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:11.113220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] PATH_INFO: `/v3/projects/5735629bb154485091012565f1a3194b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:11.114406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5735629bb154485091012565f1a3194b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:11.116309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:11.163071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5735629bb154485091012565f1a3194b', 'request_id': 'req-593534c5-0b36-4f7a-878e-0fa57b1d8332'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:11.169959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5735629bb154485091012565f1a3194b', 'request_id': 'req-593534c5-0b36-4f7a-878e-0fa57b1d8332'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:11.176815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5735629bb154485091012565f1a3194b', 'request_id': 'req-593534c5-0b36-4f7a-878e-0fa57b1d8332'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:11.187701 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] The token cache is being invalidate because project 5735629bb154485091012565f1a3194b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:55:11.187985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:11.188623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:11.190158 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1233/2423] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:55:11 2022] DELETE /identity/v3/projects/5735629bb154485091012565f1a3194b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:18.082646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:18.084284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:18.145805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd62362-7baa-426a-b7be-fb9c287212b6 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:18.197036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46096356-eec7-46f2-aa69-b9ff6db1c219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:18.197725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46096356-eec7-46f2-aa69-b9ff6db1c219 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:18.198008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46096356-eec7-46f2-aa69-b9ff6db1c219 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:18.198466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46096356-eec7-46f2-aa69-b9ff6db1c219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:18.200799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-46096356-eec7-46f2-aa69-b9ff6db1c219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:18.246526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:18.278582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46096356-eec7-46f2-aa69-b9ff6db1c219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:18.280249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46096356-eec7-46f2-aa69-b9ff6db1c219 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:18.292408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1191/2424] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:21.184261 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:25.002714 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:25.004204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:25.017293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593534c5-0b36-4f7a-878e-0fa57b1d8332 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:25.020964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:25.021633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:25.021913 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:25.022183 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:25.024386 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:25.038754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:25.040166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:25.050922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1234/2425] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:28.286845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=14 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:32.386205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46096356-eec7-46f2-aa69-b9ff6db1c219 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:32.395309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46096356-eec7-46f2-aa69-b9ff6db1c219 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:32.398988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:32.399622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:32.399914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:32.400212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:32.401938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:32.465749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:32.467206 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:32.477160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1192/2426] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:34.623889 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:34.625231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:34.641376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252e253-6ffb-49b2-8b3f-0b653eab50f9 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:34.648461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119cb35-0abc-456d-a921-4f4cac970792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:34.649318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119cb35-0abc-456d-a921-4f4cac970792 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:34.649761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119cb35-0abc-456d-a921-4f4cac970792 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:34.650198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119cb35-0abc-456d-a921-4f4cac970792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:34.652727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c119cb35-0abc-456d-a921-4f4cac970792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:34.734247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119cb35-0abc-456d-a921-4f4cac970792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:34.735901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119cb35-0abc-456d-a921-4f4cac970792 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:34.745337 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1235/2427] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:35.739921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:35.741757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:35.754695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea9d69-1589-441a-8e25-bf6f8a308c0a service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:35.759273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:35.760140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:35.760412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:35.760679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] PATH_INFO: `/v3/users/aacb60b92e9346dda3f4e2c43885a883` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:35.762442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aacb60b92e9346dda3f4e2c43885a883)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:35.764355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:35.810679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aacb60b92e9346dda3f4e2c43885a883'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:35.822196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aacb60b92e9346dda3f4e2c43885a883'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:35.822911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aacb60b92e9346dda3f4e2c43885a883'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:35.830374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aacb60b92e9346dda3f4e2c43885a883'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:35.838196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c222d77e-bcb2-4d18-89d7-6d4ee7b335a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aacb60b92e9346dda3f4e2c43885a883'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:35.844602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1193/2428] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:55:35 2022] DELETE /identity/v3/users/aacb60b92e9346dda3f4e2c43885a883 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:36.317887 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119cb35-0abc-456d-a921-4f4cac970792 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:36.331401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119cb35-0abc-456d-a921-4f4cac970792 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:36.400488 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:36.401349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.401630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.401910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] PATH_INFO: `/v3/projects/ebbf35a731034734b426712b9abe5bbc` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.403153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbf35a731034734b426712b9abe5bbc)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:36.405070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:36.452690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbf35a731034734b426712b9abe5bbc', 'request_id': 'req-cf68cb22-d165-4b69-b604-bcefa3274cef'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:36.459573 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbf35a731034734b426712b9abe5bbc', 'request_id': 'req-cf68cb22-d165-4b69-b604-bcefa3274cef'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:36.468192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbf35a731034734b426712b9abe5bbc', 'request_id': 'req-cf68cb22-d165-4b69-b604-bcefa3274cef'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:36.480952 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] The token cache is being invalidate because project ebbf35a731034734b426712b9abe5bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:55:36.481175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:36.481816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-cf68cb22-d165-4b69-b604-bcefa3274cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:36.483474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1236/2429] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:55:36 2022] DELETE /identity/v3/projects/ebbf35a731034734b426712b9abe5bbc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:36.488750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b1fa0-32bb-4a3d-bd64-b19aeb2495ec None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.489044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b1fa0-32bb-4a3d-bd64-b19aeb2495ec None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.489360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b1fa0-32bb-4a3d-bd64-b19aeb2495ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.512680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e97b1fa0-32bb-4a3d-bd64-b19aeb2495ec None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:36.513948 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e97b1fa0-32bb-4a3d-bd64-b19aeb2495ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:36.577222 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1194/2430] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:36.586371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192953c1-ec91-48ea-a82d-90a9bf87ecfb None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.586760 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192953c1-ec91-48ea-a82d-90a9bf87ecfb None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.587165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192953c1-ec91-48ea-a82d-90a9bf87ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.607615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-192953c1-ec91-48ea-a82d-90a9bf87ecfb None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:36.608837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-192953c1-ec91-48ea-a82d-90a9bf87ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:36.616885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1237/2431] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:36.621783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b1fa0-32bb-4a3d-bd64-b19aeb2495ec None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:36.631493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b1fa0-32bb-4a3d-bd64-b19aeb2495ec None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:36.636124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a3746-692f-4d1b-ad16-f4678a48c443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:36.636812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3746-692f-4d1b-ad16-f4678a48c443 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.637091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3746-692f-4d1b-ad16-f4678a48c443 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.637370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3746-692f-4d1b-ad16-f4678a48c443 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.638089 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a3746-692f-4d1b-ad16-f4678a48c443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:55:36.638406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a3746-692f-4d1b-ad16-f4678a48c443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:36.640023 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a3746-692f-4d1b-ad16-f4678a48c443 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:36.641593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:36.654832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1195/2432] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:55:36.659408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192953c1-ec91-48ea-a82d-90a9bf87ecfb None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:36.669573 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192953c1-ec91-48ea-a82d-90a9bf87ecfb None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:36.674501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42f780-7d06-49e7-8928-6f57ea1584bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:36.675164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42f780-7d06-49e7-8928-6f57ea1584bd admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.675447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42f780-7d06-49e7-8928-6f57ea1584bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.675723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42f780-7d06-49e7-8928-6f57ea1584bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.676424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42f780-7d06-49e7-8928-6f57ea1584bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:36.678370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42f780-7d06-49e7-8928-6f57ea1584bd admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:36.682654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:36.706931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1238/2433] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:55:36 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:36.711346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a3746-692f-4d1b-ad16-f4678a48c443 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:36.724201 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a3746-692f-4d1b-ad16-f4678a48c443 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:36.783022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1bba3-a4f7-41b0-990f-31627dc7af2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:36.783790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1bba3-a4f7-41b0-990f-31627dc7af2e admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.783902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1bba3-a4f7-41b0-990f-31627dc7af2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.784181 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1bba3-a4f7-41b0-990f-31627dc7af2e admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.784895 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1bba3-a4f7-41b0-990f-31627dc7af2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:36.786933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1bba3-a4f7-41b0-990f-31627dc7af2e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:36.807736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1196/2434] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:55:36 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:36.812447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42f780-7d06-49e7-8928-6f57ea1584bd admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:36.822705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42f780-7d06-49e7-8928-6f57ea1584bd admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:36.827708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdad5f5-6a7f-4eca-8520-cd1606628c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:36.828370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdad5f5-6a7f-4eca-8520-cd1606628c08 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.828654 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdad5f5-6a7f-4eca-8520-cd1606628c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.828929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdad5f5-6a7f-4eca-8520-cd1606628c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.829649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdad5f5-6a7f-4eca-8520-cd1606628c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:36.831277 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdad5f5-6a7f-4eca-8520-cd1606628c08 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:36.843004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1239/2435] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:36.847052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1bba3-a4f7-41b0-990f-31627dc7af2e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:36.857681 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1bba3-a4f7-41b0-990f-31627dc7af2e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:36.862276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6bcc6-5a2a-4b61-92a5-f4ca8d0f3207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:36.862977 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bcc6-5a2a-4b61-92a5-f4ca8d0f3207 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.863244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bcc6-5a2a-4b61-92a5-f4ca8d0f3207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.863517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6bcc6-5a2a-4b61-92a5-f4ca8d0f3207 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.864232 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6bcc6-5a2a-4b61-92a5-f4ca8d0f3207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:36.865824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6bcc6-5a2a-4b61-92a5-f4ca8d0f3207 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:36.876635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1197/2436] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:36.880995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdad5f5-6a7f-4eca-8520-cd1606628c08 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:36.890995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdad5f5-6a7f-4eca-8520-cd1606628c08 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:36.895613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dc7e3-b295-480c-8aa1-9fb0a62df85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:36.896480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dc7e3-b295-480c-8aa1-9fb0a62df85b admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.896756 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dc7e3-b295-480c-8aa1-9fb0a62df85b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.897040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dc7e3-b295-480c-8aa1-9fb0a62df85b admin admin] PATH_INFO: `/v3/projects/279d6d6928d44529a10f3ed9262d3633/users/21f3c08d9a5c452ba916c5e87d53e3aa/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.911637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dc7e3-b295-480c-8aa1-9fb0a62df85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=279d6d6928d44529a10f3ed9262d3633, user_id=21f3c08d9a5c452ba916c5e87d53e3aa, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:36.914586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dc7e3-b295-480c-8aa1-9fb0a62df85b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:36.927576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1240/2437] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:36 2022] PUT /identity/v3/projects/279d6d6928d44529a10f3ed9262d3633/users/21f3c08d9a5c452ba916c5e87d53e3aa/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:36.932875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aa315-e9ae-4a7f-8f24-7f5b76f3fdff None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:36.933207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aa315-e9ae-4a7f-8f24-7f5b76f3fdff None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:36.934137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aa315-e9ae-4a7f-8f24-7f5b76f3fdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:36.952435 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-883aa315-e9ae-4a7f-8f24-7f5b76f3fdff None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:36.953649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-883aa315-e9ae-4a7f-8f24-7f5b76f3fdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:37.020222 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1198/2438] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:37.030320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dc7e3-b295-480c-8aa1-9fb0a62df85b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:37.032123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-b56dc7e3-b295-480c-8aa1-9fb0a62df85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:37.092946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dc7e3-b295-480c-8aa1-9fb0a62df85b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:37.096606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cdc5c-b660-45f1-88b1-fd72a74a3a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:37.097250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cdc5c-b660-45f1-88b1-fd72a74a3a64 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:37.097535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cdc5c-b660-45f1-88b1-fd72a74a3a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:37.097814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cdc5c-b660-45f1-88b1-fd72a74a3a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:37.107557 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cdc5c-b660-45f1-88b1-fd72a74a3a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:37.109001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cdc5c-b660-45f1-88b1-fd72a74a3a64 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:37.118505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1241/2439] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:37.773715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e666c-efe2-4fcb-a643-83192c7957f6 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:37.774005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e666c-efe2-4fcb-a643-83192c7957f6 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:37.774317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e666c-efe2-4fcb-a643-83192c7957f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:37.806155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7f2e666c-efe2-4fcb-a643-83192c7957f6 None None] MFA Rules not processed for user `21f3c08d9a5c452ba916c5e87d53e3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:37.807522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7f2e666c-efe2-4fcb-a643-83192c7957f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:37.874991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1199/2440] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:37.879512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cdc5c-b660-45f1-88b1-fd72a74a3a64 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:37.889524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cdc5c-b660-45f1-88b1-fd72a74a3a64 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:37.894489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9018d-9098-405d-a266-6a5eecdb2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:37.895344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9018d-9098-405d-a266-6a5eecdb2cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:37.895588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9018d-9098-405d-a266-6a5eecdb2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:37.895821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9018d-9098-405d-a266-6a5eecdb2cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:37.896532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9018d-9098-405d-a266-6a5eecdb2cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:37.898469 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9018d-9098-405d-a266-6a5eecdb2cc0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:37.936711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1242/2441] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:55:37 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:55:37.940695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e666c-efe2-4fcb-a643-83192c7957f6 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:37.946367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:37.954321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e666c-efe2-4fcb-a643-83192c7957f6 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:38.010102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d4c37-c812-4213-bbbf-76fcb1deef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:38.010806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d4c37-c812-4213-bbbf-76fcb1deef26 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:38.011088 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d4c37-c812-4213-bbbf-76fcb1deef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:38.011390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d4c37-c812-4213-bbbf-76fcb1deef26 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:38.012678 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d4c37-c812-4213-bbbf-76fcb1deef26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:38.014724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d4c37-c812-4213-bbbf-76fcb1deef26 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:38.034845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1200/2442] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:55:37 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:55:38.039237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9018d-9098-405d-a266-6a5eecdb2cc0 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:38.050314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9018d-9098-405d-a266-6a5eecdb2cc0 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:38.054988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357405b-ca29-42a2-9123-9af942913c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:38.055666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357405b-ca29-42a2-9123-9af942913c64 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:38.055940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357405b-ca29-42a2-9123-9af942913c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:38.056217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357405b-ca29-42a2-9123-9af942913c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:38.056950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357405b-ca29-42a2-9123-9af942913c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:38.059114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357405b-ca29-42a2-9123-9af942913c64 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:38.070484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1243/2443] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:38.075328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d4c37-c812-4213-bbbf-76fcb1deef26 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:38.085551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d4c37-c812-4213-bbbf-76fcb1deef26 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:38.090230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becce75a-64e1-415d-9f8d-ebf135fbaa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:38.091153 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becce75a-64e1-415d-9f8d-ebf135fbaa62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:38.091465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becce75a-64e1-415d-9f8d-ebf135fbaa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:38.091741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becce75a-64e1-415d-9f8d-ebf135fbaa62 admin admin] PATH_INFO: `/v3/projects/fbc909e90f1946d78cb2c67400f4aa74/users/eedc668e8497499198bab43f5a467c13/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:38.107095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becce75a-64e1-415d-9f8d-ebf135fbaa62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc909e90f1946d78cb2c67400f4aa74, user_id=eedc668e8497499198bab43f5a467c13, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:38.109788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becce75a-64e1-415d-9f8d-ebf135fbaa62 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:38.123789 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1201/2444] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:38 2022] PUT /identity/v3/projects/fbc909e90f1946d78cb2c67400f4aa74/users/eedc668e8497499198bab43f5a467c13/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:38.127699 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357405b-ca29-42a2-9123-9af942913c64 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:38.137935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357405b-ca29-42a2-9123-9af942913c64 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:38.194100 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff7c07-7a3f-4b78-bb44-bf7ea5a15d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:38.194797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff7c07-7a3f-4b78-bb44-bf7ea5a15d29 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:38.195130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff7c07-7a3f-4b78-bb44-bf7ea5a15d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:38.195358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff7c07-7a3f-4b78-bb44-bf7ea5a15d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:38.196079 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff7c07-7a3f-4b78-bb44-bf7ea5a15d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:38.197658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff7c07-7a3f-4b78-bb44-bf7ea5a15d29 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:38.207495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1244/2445] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:38.211688 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becce75a-64e1-415d-9f8d-ebf135fbaa62 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:38.221866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becce75a-64e1-415d-9f8d-ebf135fbaa62 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:38.226966 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fe54c-b372-4255-9625-c16dc7cac921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:38.227843 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fe54c-b372-4255-9625-c16dc7cac921 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:38.228203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fe54c-b372-4255-9625-c16dc7cac921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:38.228526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fe54c-b372-4255-9625-c16dc7cac921 admin admin] PATH_INFO: `/v3/projects/fbc909e90f1946d78cb2c67400f4aa74/users/eedc668e8497499198bab43f5a467c13/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:38.231245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fe54c-b372-4255-9625-c16dc7cac921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc909e90f1946d78cb2c67400f4aa74, user_id=eedc668e8497499198bab43f5a467c13, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:38.233907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fe54c-b372-4255-9625-c16dc7cac921 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:38.244393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1202/2446] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:38 2022] PUT /identity/v3/projects/fbc909e90f1946d78cb2c67400f4aa74/users/eedc668e8497499198bab43f5a467c13/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:38.972728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb5a40-1cac-47c3-8e0c-0c96b44e0b90 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:38.973328 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb5a40-1cac-47c3-8e0c-0c96b44e0b90 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:38.973454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb5a40-1cac-47c3-8e0c-0c96b44e0b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:39.000036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d6bb5a40-1cac-47c3-8e0c-0c96b44e0b90 None None] MFA Rules not processed for user `eedc668e8497499198bab43f5a467c13`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:39.001260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d6bb5a40-1cac-47c3-8e0c-0c96b44e0b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:39.007008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:39.078957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1245/2447] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:40.204974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fe54c-b372-4255-9625-c16dc7cac921 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:40.269817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fe54c-b372-4255-9625-c16dc7cac921 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:40.274476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:40.275382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:40.275667 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:40.275942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] PATH_INFO: `/v3/users/21f3c08d9a5c452ba916c5e87d53e3aa` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:40.277181 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f3c08d9a5c452ba916c5e87d53e3aa)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:40.279158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:40.327682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f3c08d9a5c452ba916c5e87d53e3aa'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.334590 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:40.341606 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f3c08d9a5c452ba916c5e87d53e3aa'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.342734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f3c08d9a5c452ba916c5e87d53e3aa'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.349859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f3c08d9a5c452ba916c5e87d53e3aa'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.358046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f3c08d9a5c452ba916c5e87d53e3aa'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.364377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1203/2448] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:55:40 2022] DELETE /identity/v3/users/21f3c08d9a5c452ba916c5e87d53e3aa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:40.548825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb5a40-1cac-47c3-8e0c-0c96b44e0b90 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:40.560098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb5a40-1cac-47c3-8e0c-0c96b44e0b90 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:40.627210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:40.628077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:40.628356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:40.628636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] PATH_INFO: `/v3/projects/279d6d6928d44529a10f3ed9262d3633` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:40.629821 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=279d6d6928d44529a10f3ed9262d3633)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:40.631762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:40.678991 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279d6d6928d44529a10f3ed9262d3633', 'request_id': 'req-84991296-fedd-4d6a-9b5e-72a3094b4620'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.685994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279d6d6928d44529a10f3ed9262d3633', 'request_id': 'req-84991296-fedd-4d6a-9b5e-72a3094b4620'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.693908 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279d6d6928d44529a10f3ed9262d3633', 'request_id': 'req-84991296-fedd-4d6a-9b5e-72a3094b4620'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.704738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] The token cache is being invalidate because project 279d6d6928d44529a10f3ed9262d3633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:55:40.705029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.705660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.707247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1246/2449] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:55:40 2022] DELETE /identity/v3/projects/279d6d6928d44529a10f3ed9262d3633 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:40.711301 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:40.712746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:40.725611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898720d9-ce33-42e2-bccb-11ac2708efb0 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:40.783910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:40.784787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:40.785070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:40.785367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] PATH_INFO: `/v3/users/eedc668e8497499198bab43f5a467c13` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:40.786591 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eedc668e8497499198bab43f5a467c13)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:40.788788 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:40.833912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eedc668e8497499198bab43f5a467c13'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.846757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eedc668e8497499198bab43f5a467c13'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.847458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eedc668e8497499198bab43f5a467c13'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.854534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eedc668e8497499198bab43f5a467c13'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.862549 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-27a053ce-36f1-4883-82f3-bedcb8c1801a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eedc668e8497499198bab43f5a467c13'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:40.869594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1204/2450] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:55:40 2022] DELETE /identity/v3/users/eedc668e8497499198bab43f5a467c13 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:55:41.129059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:41.130715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:41.144741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991296-fedd-4d6a-9b5e-72a3094b4620 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:41.177337 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:41.205343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:41.206211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.206536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.206817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] PATH_INFO: `/v3/projects/fbc909e90f1946d78cb2c67400f4aa74` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.208018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc909e90f1946d78cb2c67400f4aa74)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:41.209974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:41.258409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc909e90f1946d78cb2c67400f4aa74', 'request_id': 'req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:41.265393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc909e90f1946d78cb2c67400f4aa74', 'request_id': 'req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:41.274622 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc909e90f1946d78cb2c67400f4aa74', 'request_id': 'req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:41.286254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] The token cache is being invalidate because project fbc909e90f1946d78cb2c67400f4aa74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:55:41.286571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:41.287516 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2bb19f94-9df6-421a-8348-fb0cb0d6b6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:41.289079 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1247/2451] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:55:41 2022] DELETE /identity/v3/projects/fbc909e90f1946d78cb2c67400f4aa74 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:55:41.294192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92c3f4-1319-4a3b-8706-55d240732ed1 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.294720 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92c3f4-1319-4a3b-8706-55d240732ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.294840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92c3f4-1319-4a3b-8706-55d240732ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.325552 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-5f92c3f4-1319-4a3b-8706-55d240732ed1 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:41.326961 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5f92c3f4-1319-4a3b-8706-55d240732ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:41.375813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:41.390012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1205/2452] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:41.397900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaefb85-4b33-4e24-bd6b-e566007b11d4 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.398166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaefb85-4b33-4e24-bd6b-e566007b11d4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.398481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaefb85-4b33-4e24-bd6b-e566007b11d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.418969 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3aaefb85-4b33-4e24-bd6b-e566007b11d4 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:41.420338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3aaefb85-4b33-4e24-bd6b-e566007b11d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:41.428408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1248/2453] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:41.432881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92c3f4-1319-4a3b-8706-55d240732ed1 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:41.442842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92c3f4-1319-4a3b-8706-55d240732ed1 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:41.447344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537f490-a6ed-4b63-b8ca-9e3ecf1ea2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:41.448007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537f490-a6ed-4b63-b8ca-9e3ecf1ea2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.448284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537f490-a6ed-4b63-b8ca-9e3ecf1ea2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.448559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537f490-a6ed-4b63-b8ca-9e3ecf1ea2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.449793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537f490-a6ed-4b63-b8ca-9e3ecf1ea2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:55:41.450099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537f490-a6ed-4b63-b8ca-9e3ecf1ea2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:41.451737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537f490-a6ed-4b63-b8ca-9e3ecf1ea2c2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:41.463643 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1206/2454] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:55:41.468899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaefb85-4b33-4e24-bd6b-e566007b11d4 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:41.478656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaefb85-4b33-4e24-bd6b-e566007b11d4 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:41.484401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87925d-a8f0-40ec-8a09-fcff0e738995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:41.485117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87925d-a8f0-40ec-8a09-fcff0e738995 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.485440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87925d-a8f0-40ec-8a09-fcff0e738995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.485752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87925d-a8f0-40ec-8a09-fcff0e738995 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.486524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87925d-a8f0-40ec-8a09-fcff0e738995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:41.488517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87925d-a8f0-40ec-8a09-fcff0e738995 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:41.517826 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1249/2455] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:55:41 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:41.522406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537f490-a6ed-4b63-b8ca-9e3ecf1ea2c2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:41.532872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537f490-a6ed-4b63-b8ca-9e3ecf1ea2c2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:41.590492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a3e85-4d04-4f55-befa-95e00016ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:41.591163 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a3e85-4d04-4f55-befa-95e00016ccf7 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.591465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a3e85-4d04-4f55-befa-95e00016ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.591738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a3e85-4d04-4f55-befa-95e00016ccf7 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.592434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a3e85-4d04-4f55-befa-95e00016ccf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:41.594418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a3e85-4d04-4f55-befa-95e00016ccf7 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:41.615209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1207/2456] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:55:41 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:41.619592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87925d-a8f0-40ec-8a09-fcff0e738995 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:41.630974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87925d-a8f0-40ec-8a09-fcff0e738995 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:41.635663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e6a6c-96b0-4c27-8b69-925b1465cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:41.636966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e6a6c-96b0-4c27-8b69-925b1465cc1e admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.637247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e6a6c-96b0-4c27-8b69-925b1465cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.637518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e6a6c-96b0-4c27-8b69-925b1465cc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.638234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e6a6c-96b0-4c27-8b69-925b1465cc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:41.639867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e6a6c-96b0-4c27-8b69-925b1465cc1e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:41.650863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1250/2457] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:41.655106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a3e85-4d04-4f55-befa-95e00016ccf7 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:41.666007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a3e85-4d04-4f55-befa-95e00016ccf7 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:41.671533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a65c42-29b2-4275-9c13-4ce5bc9b2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:41.672244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65c42-29b2-4275-9c13-4ce5bc9b2e61 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.672522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65c42-29b2-4275-9c13-4ce5bc9b2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.672797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65c42-29b2-4275-9c13-4ce5bc9b2e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.673521 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a65c42-29b2-4275-9c13-4ce5bc9b2e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:41.675201 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a65c42-29b2-4275-9c13-4ce5bc9b2e61 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:41.686122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1208/2458] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:41.690523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e6a6c-96b0-4c27-8b69-925b1465cc1e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:41.701310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e6a6c-96b0-4c27-8b69-925b1465cc1e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:41.706035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05dafc-1712-4c12-a23f-28ed390f580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:41.706963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05dafc-1712-4c12-a23f-28ed390f580d admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.707247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05dafc-1712-4c12-a23f-28ed390f580d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.707527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05dafc-1712-4c12-a23f-28ed390f580d admin admin] PATH_INFO: `/v3/projects/c8fdd4035477406f8b27ac38514a2cf7/users/2a33b8e723314589a8725cda0e67c0c7/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.722736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05dafc-1712-4c12-a23f-28ed390f580d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fdd4035477406f8b27ac38514a2cf7, user_id=2a33b8e723314589a8725cda0e67c0c7, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:41.725390 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05dafc-1712-4c12-a23f-28ed390f580d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:41.738667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1251/2459] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:41 2022] PUT /identity/v3/projects/c8fdd4035477406f8b27ac38514a2cf7/users/2a33b8e723314589a8725cda0e67c0c7/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:41.750965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ed17a-2941-4d02-b5e3-90bbb0d63f52 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.751254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ed17a-2941-4d02-b5e3-90bbb0d63f52 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.751534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ed17a-2941-4d02-b5e3-90bbb0d63f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.778781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-932ed17a-2941-4d02-b5e3-90bbb0d63f52 None None] MFA Rules not processed for user `2a33b8e723314589a8725cda0e67c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:41.779995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-932ed17a-2941-4d02-b5e3-90bbb0d63f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:41.844747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1209/2460] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:41.849377 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05dafc-1712-4c12-a23f-28ed390f580d admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:41.913609 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05dafc-1712-4c12-a23f-28ed390f580d admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:41.918869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761bf2-5bc6-4017-a85a-ac569c8ad683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:41.919539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761bf2-5bc6-4017-a85a-ac569c8ad683 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:41.919825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761bf2-5bc6-4017-a85a-ac569c8ad683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:41.920104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76761bf2-5bc6-4017-a85a-ac569c8ad683 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:41.920790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76761bf2-5bc6-4017-a85a-ac569c8ad683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:41.922771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76761bf2-5bc6-4017-a85a-ac569c8ad683 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:41.926396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:41.950689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1252/2461] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:55:41 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:41.954344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ed17a-2941-4d02-b5e3-90bbb0d63f52 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:41.965230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ed17a-2941-4d02-b5e3-90bbb0d63f52 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.010757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:42.023723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d428c0-bf28-414f-9412-1de7ed72f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.024400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d428c0-bf28-414f-9412-1de7ed72f2fc admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.024687 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d428c0-bf28-414f-9412-1de7ed72f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.024963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d428c0-bf28-414f-9412-1de7ed72f2fc admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.025659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d428c0-bf28-414f-9412-1de7ed72f2fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.027637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d428c0-bf28-414f-9412-1de7ed72f2fc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.049470 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1210/2462] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:55:41 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:42.053452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761bf2-5bc6-4017-a85a-ac569c8ad683 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.064798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76761bf2-5bc6-4017-a85a-ac569c8ad683 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.069565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41862bef-3825-46a0-a10d-90f91e0f199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.070226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41862bef-3825-46a0-a10d-90f91e0f199c admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.070541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41862bef-3825-46a0-a10d-90f91e0f199c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.070820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41862bef-3825-46a0-a10d-90f91e0f199c admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.071574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41862bef-3825-46a0-a10d-90f91e0f199c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.073413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41862bef-3825-46a0-a10d-90f91e0f199c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.084325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1253/2463] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:42.088399 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d428c0-bf28-414f-9412-1de7ed72f2fc admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.098360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d428c0-bf28-414f-9412-1de7ed72f2fc admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.103103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d500af1-ba76-4a22-b3f2-8d7b9b7cad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.103763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500af1-ba76-4a22-b3f2-8d7b9b7cad9d admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.104048 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500af1-ba76-4a22-b3f2-8d7b9b7cad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.104324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500af1-ba76-4a22-b3f2-8d7b9b7cad9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.105554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d500af1-ba76-4a22-b3f2-8d7b9b7cad9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.107202 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d500af1-ba76-4a22-b3f2-8d7b9b7cad9d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.119949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1211/2464] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:42.122773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41862bef-3825-46a0-a10d-90f91e0f199c admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.133218 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41862bef-3825-46a0-a10d-90f91e0f199c admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.138104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e2a72-96ce-48c2-a076-ce18b90d1a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.139043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e2a72-96ce-48c2-a076-ce18b90d1a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.139332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e2a72-96ce-48c2-a076-ce18b90d1a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.139614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e2a72-96ce-48c2-a076-ce18b90d1a08 admin admin] PATH_INFO: `/v3/projects/495abebd79204ab899e36e39cd1f596e/users/c7a4da69d6b24e88bbff156856eb58ec/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.155089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e2a72-96ce-48c2-a076-ce18b90d1a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495abebd79204ab899e36e39cd1f596e, user_id=c7a4da69d6b24e88bbff156856eb58ec, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.157739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e2a72-96ce-48c2-a076-ce18b90d1a08 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.173930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1254/2465] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:42 2022] PUT /identity/v3/projects/495abebd79204ab899e36e39cd1f596e/users/c7a4da69d6b24e88bbff156856eb58ec/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:55:42.187477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31893df9-a270-4970-b206-4bc3554ab6e3 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.187768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31893df9-a270-4970-b206-4bc3554ab6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.188049 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31893df9-a270-4970-b206-4bc3554ab6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.218602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-31893df9-a270-4970-b206-4bc3554ab6e3 None None] MFA Rules not processed for user `c7a4da69d6b24e88bbff156856eb58ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:42.219832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-31893df9-a270-4970-b206-4bc3554ab6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:42.301205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1212/2466] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:42.307380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e2a72-96ce-48c2-a076-ce18b90d1a08 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.372703 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e2a72-96ce-48c2-a076-ce18b90d1a08 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.377523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925e1e8-b334-466a-95d8-ecf38fd37b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.378220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925e1e8-b334-466a-95d8-ecf38fd37b29 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.378543 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925e1e8-b334-466a-95d8-ecf38fd37b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.378820 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925e1e8-b334-466a-95d8-ecf38fd37b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.379527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925e1e8-b334-466a-95d8-ecf38fd37b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.381427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925e1e8-b334-466a-95d8-ecf38fd37b29 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.411946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1255/2467] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:55:42 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:55:42.415720 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31893df9-a270-4970-b206-4bc3554ab6e3 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.427125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31893df9-a270-4970-b206-4bc3554ab6e3 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.483909 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e966c7f-ab86-47a8-85d3-b794e3d8e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.484902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e966c7f-ab86-47a8-85d3-b794e3d8e86a admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.485180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e966c7f-ab86-47a8-85d3-b794e3d8e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.485486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e966c7f-ab86-47a8-85d3-b794e3d8e86a admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.486166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e966c7f-ab86-47a8-85d3-b794e3d8e86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.488128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e966c7f-ab86-47a8-85d3-b794e3d8e86a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.511679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1213/2468] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:55:42 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:42.515878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925e1e8-b334-466a-95d8-ecf38fd37b29 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.526450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925e1e8-b334-466a-95d8-ecf38fd37b29 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.531938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896372a-0e7d-431b-be81-fd62be6d2643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.532613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896372a-0e7d-431b-be81-fd62be6d2643 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.532892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896372a-0e7d-431b-be81-fd62be6d2643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.533167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896372a-0e7d-431b-be81-fd62be6d2643 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.533892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896372a-0e7d-431b-be81-fd62be6d2643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.535548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896372a-0e7d-431b-be81-fd62be6d2643 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.547495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1256/2469] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:42.551953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e966c7f-ab86-47a8-85d3-b794e3d8e86a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.562003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e966c7f-ab86-47a8-85d3-b794e3d8e86a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.566754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe18e8-7b35-4ef7-b3bf-159da42bc744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.567712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe18e8-7b35-4ef7-b3bf-159da42bc744 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.567980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe18e8-7b35-4ef7-b3bf-159da42bc744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.568171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe18e8-7b35-4ef7-b3bf-159da42bc744 admin admin] PATH_INFO: `/v3/projects/ddaa8bed508c423e9fce75ebd79a4a32/users/a2746b1a49dc4a6982c3196cbc2e5e76/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.584650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe18e8-7b35-4ef7-b3bf-159da42bc744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddaa8bed508c423e9fce75ebd79a4a32, user_id=a2746b1a49dc4a6982c3196cbc2e5e76, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.587336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe18e8-7b35-4ef7-b3bf-159da42bc744 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.601512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1214/2470] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:42 2022] PUT /identity/v3/projects/ddaa8bed508c423e9fce75ebd79a4a32/users/a2746b1a49dc4a6982c3196cbc2e5e76/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:42.606435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896372a-0e7d-431b-be81-fd62be6d2643 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.616593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896372a-0e7d-431b-be81-fd62be6d2643 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.673161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced7b54-f8f8-4fc3-b986-35db6ff85695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.673849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced7b54-f8f8-4fc3-b986-35db6ff85695 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.674006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced7b54-f8f8-4fc3-b986-35db6ff85695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.674280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced7b54-f8f8-4fc3-b986-35db6ff85695 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.675029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced7b54-f8f8-4fc3-b986-35db6ff85695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.676610 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced7b54-f8f8-4fc3-b986-35db6ff85695 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.686625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1257/2471] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:42.691446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe18e8-7b35-4ef7-b3bf-159da42bc744 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.702305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe18e8-7b35-4ef7-b3bf-159da42bc744 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.706928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6b85-470d-4e46-8bda-a413df8ebdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.707797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6b85-470d-4e46-8bda-a413df8ebdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.708074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6b85-470d-4e46-8bda-a413df8ebdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.708436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6b85-470d-4e46-8bda-a413df8ebdf5 admin admin] PATH_INFO: `/v3/projects/ddaa8bed508c423e9fce75ebd79a4a32/users/a2746b1a49dc4a6982c3196cbc2e5e76/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.710400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c6b85-470d-4e46-8bda-a413df8ebdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddaa8bed508c423e9fce75ebd79a4a32, user_id=a2746b1a49dc4a6982c3196cbc2e5e76, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.713058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c6b85-470d-4e46-8bda-a413df8ebdf5 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.724255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1215/2472] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:42 2022] PUT /identity/v3/projects/ddaa8bed508c423e9fce75ebd79a4a32/users/a2746b1a49dc4a6982c3196cbc2e5e76/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:42.734674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb189be-d816-44ee-aaa3-20b79ab03411 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.734966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb189be-d816-44ee-aaa3-20b79ab03411 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.735247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb189be-d816-44ee-aaa3-20b79ab03411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.763254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-fdb189be-d816-44ee-aaa3-20b79ab03411 None None] MFA Rules not processed for user `a2746b1a49dc4a6982c3196cbc2e5e76`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:42.764522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-fdb189be-d816-44ee-aaa3-20b79ab03411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:42.773376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:42.841090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1258/2473] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:42.851871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6b85-470d-4e46-8bda-a413df8ebdf5 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:42.853586 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ae8c6b85-470d-4e46-8bda-a413df8ebdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:42.864359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:42.913573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6b85-470d-4e46-8bda-a413df8ebdf5 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:42.917195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4073-cede-4e8a-86c3-272c559e37ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:42.917836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4073-cede-4e8a-86c3-272c559e37ef service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:42.918121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4073-cede-4e8a-86c3-272c559e37ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:42.918431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4073-cede-4e8a-86c3-272c559e37ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:42.927551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb4073-cede-4e8a-86c3-272c559e37ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:42.928926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb4073-cede-4e8a-86c3-272c559e37ef service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:42.938415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1216/2474] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:43.432799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb189be-d816-44ee-aaa3-20b79ab03411 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:43.434708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-fdb189be-d816-44ee-aaa3-20b79ab03411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:43.446901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb189be-d816-44ee-aaa3-20b79ab03411 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:43.451360 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7a911-e1a9-456a-a85e-5ec59ef36f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:43.452049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7a911-e1a9-456a-a85e-5ec59ef36f99 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:43.452331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7a911-e1a9-456a-a85e-5ec59ef36f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:43.452605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7a911-e1a9-456a-a85e-5ec59ef36f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:43.521960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7a911-e1a9-456a-a85e-5ec59ef36f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:43.523739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7a911-e1a9-456a-a85e-5ec59ef36f99 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:43.534436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1259/2475] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:45.186046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4073-cede-4e8a-86c3-272c559e37ef service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:45.187602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-afbb4073-cede-4e8a-86c3-272c559e37ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:45.263962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4073-cede-4e8a-86c3-272c559e37ef service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:45.269515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:45.270171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:45.270511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:45.270791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:45.272570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:45.331522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:45.333240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:45.342612 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1217/2476] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:46.259546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4712d-2342-49b3-ad4e-e8ddeee920e7 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:46.260074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4712d-2342-49b3-ad4e-e8ddeee920e7 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:46.260074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4712d-2342-49b3-ad4e-e8ddeee920e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:46.282881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-a5f4712d-2342-49b3-ad4e-e8ddeee920e7 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:46.284071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a5f4712d-2342-49b3-ad4e-e8ddeee920e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:46.351081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1260/2477] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:55:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:46.406099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:46.408010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:46.460158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:46.481286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee765e8-bff2-4166-bee1-2fb725307fde service nova] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:46.486322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188311-14ff-42db-9e27-e96e87ac4e4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:46.487179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188311-14ff-42db-9e27-e96e87ac4e4b service swift] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:46.487500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188311-14ff-42db-9e27-e96e87ac4e4b service swift] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:46.487816 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188311-14ff-42db-9e27-e96e87ac4e4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:46.497640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188311-14ff-42db-9e27-e96e87ac4e4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:46.498700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188311-14ff-42db-9e27-e96e87ac4e4b service swift] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:46.510305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1218/2478] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:55:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:55:47.582251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4712d-2342-49b3-ad4e-e8ddeee920e7 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:47.593230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4712d-2342-49b3-ad4e-e8ddeee920e7 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:47.597012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc1cc-835f-493f-8f9f-0fe4f60ee8d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:47.597691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc1cc-835f-493f-8f9f-0fe4f60ee8d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:47.597970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc1cc-835f-493f-8f9f-0fe4f60ee8d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:47.598244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc1cc-835f-493f-8f9f-0fe4f60ee8d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:47.652367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:47.666885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bc1cc-835f-493f-8f9f-0fe4f60ee8d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:47.668401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bc1cc-835f-493f-8f9f-0fe4f60ee8d9 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:47.681965 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1261/2479] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:50.259523 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188311-14ff-42db-9e27-e96e87ac4e4b service swift] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:50.337068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188311-14ff-42db-9e27-e96e87ac4e4b service swift] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:50.345323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:50.346217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:50.346573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:50.349883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] PATH_INFO: `/v3/users/2a33b8e723314589a8725cda0e67c0c7` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:50.351648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a33b8e723314589a8725cda0e67c0c7)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:50.353903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:50.417098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a33b8e723314589a8725cda0e67c0c7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:50.432286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a33b8e723314589a8725cda0e67c0c7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:50.433233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a33b8e723314589a8725cda0e67c0c7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:50.440927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a33b8e723314589a8725cda0e67c0c7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:50.450273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a33b8e723314589a8725cda0e67c0c7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:50.457773 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1219/2480] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:55:50 2022] DELETE /identity/v3/users/2a33b8e723314589a8725cda0e67c0c7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:50.462492 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08cd6d-c739-4586-b461-a43317f59929 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:50.462987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08cd6d-c739-4586-b461-a43317f59929 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:50.463073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08cd6d-c739-4586-b461-a43317f59929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:50.487250 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4b08cd6d-c739-4586-b461-a43317f59929 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:50.488486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4b08cd6d-c739-4586-b461-a43317f59929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:50.569369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1262/2481] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:50.583991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:50.587247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:50.674426 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde6794-2250-4c62-bc06-1b359801a891 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:50.679872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d446f-4c39-4e57-891d-85350ab72076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:50.681358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d446f-4c39-4e57-891d-85350ab72076 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:50.681649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d446f-4c39-4e57-891d-85350ab72076 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:50.681929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d446f-4c39-4e57-891d-85350ab72076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:50.693468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d446f-4c39-4e57-891d-85350ab72076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:50.695007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d446f-4c39-4e57-891d-85350ab72076 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:50.701572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:50.709078 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1220/2482] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:51.320494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08cd6d-c739-4586-b461-a43317f59929 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:51.322426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4b08cd6d-c739-4586-b461-a43317f59929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:51.364933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08cd6d-c739-4586-b461-a43317f59929 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:51.383245 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:51.384294 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:51.384873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:51.385135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] PATH_INFO: `/v3/projects/c8fdd4035477406f8b27ac38514a2cf7` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:51.398472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fdd4035477406f8b27ac38514a2cf7)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:51.402190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:51.484049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fdd4035477406f8b27ac38514a2cf7', 'request_id': 'req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.492997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fdd4035477406f8b27ac38514a2cf7', 'request_id': 'req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.512380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fdd4035477406f8b27ac38514a2cf7', 'request_id': 'req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.531055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] The token cache is being invalidate because project c8fdd4035477406f8b27ac38514a2cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:55:51.531351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.532019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.533813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1263/2483] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:55:51 2022] DELETE /identity/v3/projects/c8fdd4035477406f8b27ac38514a2cf7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:51.539203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d446f-4c39-4e57-891d-85350ab72076 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:51.551533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d446f-4c39-4e57-891d-85350ab72076 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:51.639035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:51.640951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:51.641546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:51.642213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] PATH_INFO: `/v3/users/c7a4da69d6b24e88bbff156856eb58ec` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:51.643937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a4da69d6b24e88bbff156856eb58ec)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:51.646322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:51.722700 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a4da69d6b24e88bbff156856eb58ec'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.740245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a4da69d6b24e88bbff156856eb58ec'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.741121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a4da69d6b24e88bbff156856eb58ec'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.752199 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a4da69d6b24e88bbff156856eb58ec'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.762868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a4da69d6b24e88bbff156856eb58ec'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:51.774460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1221/2484] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:55:51 2022] DELETE /identity/v3/users/c7a4da69d6b24e88bbff156856eb58ec => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:52.185890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:52.187906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:52.213240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4aa5b7-b89c-4c26-8a1e-4879cc322f7e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:52.302640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:52.303788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:52.304196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:52.304482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] PATH_INFO: `/v3/projects/495abebd79204ab899e36e39cd1f596e` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:52.305681 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] RBAC: Authorizing `identity:delete_project(project_id=495abebd79204ab899e36e39cd1f596e)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:52.307635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:52.324666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:52.368910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495abebd79204ab899e36e39cd1f596e', 'request_id': 'req-db0ae4d3-591c-42ee-946c-5e5888d7473e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.375783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495abebd79204ab899e36e39cd1f596e', 'request_id': 'req-db0ae4d3-591c-42ee-946c-5e5888d7473e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.388606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495abebd79204ab899e36e39cd1f596e', 'request_id': 'req-db0ae4d3-591c-42ee-946c-5e5888d7473e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.400818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] The token cache is being invalidate because project 495abebd79204ab899e36e39cd1f596e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:55:52.401259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.402406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.404095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1264/2485] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:55:52 2022] DELETE /identity/v3/projects/495abebd79204ab899e36e39cd1f596e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:52.410644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:52.412403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:52.426024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93107656-3153-420d-996a-5bfbe1f645a8 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:52.524452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:52.525386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:52.525671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:52.525942 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] PATH_INFO: `/v3/users/a2746b1a49dc4a6982c3196cbc2e5e76` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:52.527759 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2746b1a49dc4a6982c3196cbc2e5e76)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:52.529758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:52.563859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:52.610034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2746b1a49dc4a6982c3196cbc2e5e76'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.622254 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2746b1a49dc4a6982c3196cbc2e5e76'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.623015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2746b1a49dc4a6982c3196cbc2e5e76'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.630365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2746b1a49dc4a6982c3196cbc2e5e76'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.643167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-21ff34aa-37ec-40da-a6a0-68118ee55c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2746b1a49dc4a6982c3196cbc2e5e76'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:52.652556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1222/2486] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:55:52 2022] DELETE /identity/v3/users/a2746b1a49dc4a6982c3196cbc2e5e76 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:52.999321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:53.000789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:53.024201 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ae4d3-591c-42ee-946c-5e5888d7473e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:53.141296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:53.142184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.143108 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.143352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] PATH_INFO: `/v3/projects/ddaa8bed508c423e9fce75ebd79a4a32` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.146169 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddaa8bed508c423e9fce75ebd79a4a32)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:53.148976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:53.269014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddaa8bed508c423e9fce75ebd79a4a32', 'request_id': 'req-de422bf8-5d41-4728-80cb-a00c4bd675e3'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:53.280219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddaa8bed508c423e9fce75ebd79a4a32', 'request_id': 'req-de422bf8-5d41-4728-80cb-a00c4bd675e3'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:53.294211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddaa8bed508c423e9fce75ebd79a4a32', 'request_id': 'req-de422bf8-5d41-4728-80cb-a00c4bd675e3'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:53.317267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] The token cache is being invalidate because project ddaa8bed508c423e9fce75ebd79a4a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:55:53.317858 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:53.318566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-de422bf8-5d41-4728-80cb-a00c4bd675e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:53.320454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1265/2487] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:55:52 2022] DELETE /identity/v3/projects/ddaa8bed508c423e9fce75ebd79a4a32 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:53.326795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565524-a097-45b2-a5b7-5b0064a7e8e0 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.327101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565524-a097-45b2-a5b7-5b0064a7e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.327359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565524-a097-45b2-a5b7-5b0064a7e8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.352658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-5e565524-a097-45b2-a5b7-5b0064a7e8e0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:53.353575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5e565524-a097-45b2-a5b7-5b0064a7e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:53.454566 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1223/2488] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:53.459830 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d0fb-fae2-4212-a1e7-956758fc47e8 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.460124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d0fb-fae2-4212-a1e7-956758fc47e8 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.460413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d0fb-fae2-4212-a1e7-956758fc47e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.480694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-73e3d0fb-fae2-4212-a1e7-956758fc47e8 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:53.482180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-73e3d0fb-fae2-4212-a1e7-956758fc47e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:53.490549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1266/2489] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:53.494848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e565524-a097-45b2-a5b7-5b0064a7e8e0 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:53.510636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e565524-a097-45b2-a5b7-5b0064a7e8e0 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:53.515720 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cfc0-453a-4f4d-b594-5d068a27bd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:53.516538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cfc0-453a-4f4d-b594-5d068a27bd97 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.516820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cfc0-453a-4f4d-b594-5d068a27bd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.517092 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cfc0-453a-4f4d-b594-5d068a27bd97 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.517857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047cfc0-453a-4f4d-b594-5d068a27bd97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:55:53.518182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047cfc0-453a-4f4d-b594-5d068a27bd97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:53.520122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047cfc0-453a-4f4d-b594-5d068a27bd97 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:53.539031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1224/2490] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:55:53.543712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3d0fb-fae2-4212-a1e7-956758fc47e8 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:53.559314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3d0fb-fae2-4212-a1e7-956758fc47e8 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:53.565417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040e086-d637-4fe6-afcf-274ce324f0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:53.566192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040e086-d637-4fe6-afcf-274ce324f0cd admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.566828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040e086-d637-4fe6-afcf-274ce324f0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.566966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040e086-d637-4fe6-afcf-274ce324f0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.567685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040e086-d637-4fe6-afcf-274ce324f0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:53.569818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040e086-d637-4fe6-afcf-274ce324f0cd admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:53.606556 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1267/2491] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:55:53 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:55:53.610195 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cfc0-453a-4f4d-b594-5d068a27bd97 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:53.620772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cfc0-453a-4f4d-b594-5d068a27bd97 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:53.722953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade90b3-08c0-4465-8d04-d7ac90ae649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:53.723637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade90b3-08c0-4465-8d04-d7ac90ae649e admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.723914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade90b3-08c0-4465-8d04-d7ac90ae649e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.724191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade90b3-08c0-4465-8d04-d7ac90ae649e admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.724896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade90b3-08c0-4465-8d04-d7ac90ae649e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:53.726896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade90b3-08c0-4465-8d04-d7ac90ae649e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:53.750861 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1225/2492] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:55:53 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:53.755539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040e086-d637-4fe6-afcf-274ce324f0cd admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:53.762422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:53.768987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040e086-d637-4fe6-afcf-274ce324f0cd admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:53.775816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2264c5-36b8-4231-9fc9-977acf850655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:53.777044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2264c5-36b8-4231-9fc9-977acf850655 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.777317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2264c5-36b8-4231-9fc9-977acf850655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.777688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2264c5-36b8-4231-9fc9-977acf850655 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.778339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2264c5-36b8-4231-9fc9-977acf850655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:53.780039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2264c5-36b8-4231-9fc9-977acf850655 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:53.794558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1268/2493] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:53.798610 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade90b3-08c0-4465-8d04-d7ac90ae649e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:53.817709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade90b3-08c0-4465-8d04-d7ac90ae649e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:53.822841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f06b-50f3-4161-b454-047f0a843494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:53.823850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f06b-50f3-4161-b454-047f0a843494 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.824137 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f06b-50f3-4161-b454-047f0a843494 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.824413 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f06b-50f3-4161-b454-047f0a843494 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.825148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f06b-50f3-4161-b454-047f0a843494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:53.826813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f06b-50f3-4161-b454-047f0a843494 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:53.843793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1226/2494] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:53.847895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2264c5-36b8-4231-9fc9-977acf850655 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:53.859602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2264c5-36b8-4231-9fc9-977acf850655 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:53.866357 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e86a-a90c-419a-9b3b-113647862653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:53.867402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e86a-a90c-419a-9b3b-113647862653 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.867758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e86a-a90c-419a-9b3b-113647862653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.868109 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e86a-a90c-419a-9b3b-113647862653 admin admin] PATH_INFO: `/v3/projects/9c0e3e6fcd6d45fc9eac766f9f574cc1/users/e5afefeb7e564846a6a5604c19143689/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.885051 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e86a-a90c-419a-9b3b-113647862653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0e3e6fcd6d45fc9eac766f9f574cc1, user_id=e5afefeb7e564846a6a5604c19143689, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:53.888529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e86a-a90c-419a-9b3b-113647862653 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:53.919307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1269/2495] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:53 2022] PUT /identity/v3/projects/9c0e3e6fcd6d45fc9eac766f9f574cc1/users/e5afefeb7e564846a6a5604c19143689/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:53.922676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5228fc-56fb-46fe-95f8-57fa34c71ec7 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:53.923253 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5228fc-56fb-46fe-95f8-57fa34c71ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:53.923695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5228fc-56fb-46fe-95f8-57fa34c71ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:53.935864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:53.976188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-1b5228fc-56fb-46fe-95f8-57fa34c71ec7 None None] MFA Rules not processed for user `e5afefeb7e564846a6a5604c19143689`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:53.979345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1b5228fc-56fb-46fe-95f8-57fa34c71ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:54.085595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1227/2496] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:54.091087 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e86a-a90c-419a-9b3b-113647862653 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:54.188978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e86a-a90c-419a-9b3b-113647862653 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:54.196129 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5c9ee-3bf1-47b1-b425-19518ba39114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:54.197311 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5c9ee-3bf1-47b1-b425-19518ba39114 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:54.199111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5c9ee-3bf1-47b1-b425-19518ba39114 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:54.199111 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5c9ee-3bf1-47b1-b425-19518ba39114 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:54.199558 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5c9ee-3bf1-47b1-b425-19518ba39114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:54.201354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5c9ee-3bf1-47b1-b425-19518ba39114 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:54.246315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1270/2497] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:55:54 2022] POST /identity/v3/projects => generated 399 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:54.251554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5228fc-56fb-46fe-95f8-57fa34c71ec7 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:54.267786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5228fc-56fb-46fe-95f8-57fa34c71ec7 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:54.348654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72195e40-e6a2-42db-b1c8-99a405e1c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:54.349376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72195e40-e6a2-42db-b1c8-99a405e1c842 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:54.349663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72195e40-e6a2-42db-b1c8-99a405e1c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:54.349975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72195e40-e6a2-42db-b1c8-99a405e1c842 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:54.350725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72195e40-e6a2-42db-b1c8-99a405e1c842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:54.352676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72195e40-e6a2-42db-b1c8-99a405e1c842 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:54.377397 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1228/2498] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:55:54 2022] POST /identity/v3/users => generated 306 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:55:54.381368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5c9ee-3bf1-47b1-b425-19518ba39114 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:54.393974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5c9ee-3bf1-47b1-b425-19518ba39114 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:54.399432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca681612-c105-4ec2-bb31-2c556f60a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:54.400113 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca681612-c105-4ec2-bb31-2c556f60a97c admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:54.400402 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca681612-c105-4ec2-bb31-2c556f60a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:54.400685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca681612-c105-4ec2-bb31-2c556f60a97c admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:54.401953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca681612-c105-4ec2-bb31-2c556f60a97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:54.403596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca681612-c105-4ec2-bb31-2c556f60a97c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:54.421714 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72195e40-e6a2-42db-b1c8-99a405e1c842 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:54.422168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1271/2499] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:55:54.433833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72195e40-e6a2-42db-b1c8-99a405e1c842 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:54.438902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd0f8e-fa1f-4562-b057-5c11b95b784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:54.439799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd0f8e-fa1f-4562-b057-5c11b95b784c admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:54.440164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd0f8e-fa1f-4562-b057-5c11b95b784c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:54.440446 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd0f8e-fa1f-4562-b057-5c11b95b784c admin admin] PATH_INFO: `/v3/projects/e50789d589b544b28e4d53fc75e567bf/users/c6c5c733306740d6abdc21d8bb2f34e7/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:54.460300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd0f8e-fa1f-4562-b057-5c11b95b784c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50789d589b544b28e4d53fc75e567bf, user_id=c6c5c733306740d6abdc21d8bb2f34e7, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:54.463040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd0f8e-fa1f-4562-b057-5c11b95b784c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:54.481861 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1229/2500] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:54 2022] PUT /identity/v3/projects/e50789d589b544b28e4d53fc75e567bf/users/c6c5c733306740d6abdc21d8bb2f34e7/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:54.485670 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca681612-c105-4ec2-bb31-2c556f60a97c admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:54.497452 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca681612-c105-4ec2-bb31-2c556f60a97c admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:54.573736 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b028b4e-c660-4f32-987b-ee3681347ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:54.574467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b028b4e-c660-4f32-987b-ee3681347ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:54.574750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b028b4e-c660-4f32-987b-ee3681347ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:54.575029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b028b4e-c660-4f32-987b-ee3681347ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:54.575764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b028b4e-c660-4f32-987b-ee3681347ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:54.577369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b028b4e-c660-4f32-987b-ee3681347ba6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:54.592632 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1272/2501] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:55:54.593832 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd0f8e-fa1f-4562-b057-5c11b95b784c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:54.608792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd0f8e-fa1f-4562-b057-5c11b95b784c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:54.623711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723527f-e6d3-4812-80f3-9c3e1ae4abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:54.624872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723527f-e6d3-4812-80f3-9c3e1ae4abda admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:54.625172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723527f-e6d3-4812-80f3-9c3e1ae4abda admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:54.625478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723527f-e6d3-4812-80f3-9c3e1ae4abda admin admin] PATH_INFO: `/v3/projects/e50789d589b544b28e4d53fc75e567bf/users/c6c5c733306740d6abdc21d8bb2f34e7/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:54.630644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723527f-e6d3-4812-80f3-9c3e1ae4abda admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50789d589b544b28e4d53fc75e567bf, user_id=c6c5c733306740d6abdc21d8bb2f34e7, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:54.633325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723527f-e6d3-4812-80f3-9c3e1ae4abda admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:54.656451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe14b21-abfb-4a4b-8b27-3ebe4bb4e4b4 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:54.656739 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe14b21-abfb-4a4b-8b27-3ebe4bb4e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:54.657026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe14b21-abfb-4a4b-8b27-3ebe4bb4e4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:54.658365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1230/2502] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:55:54 2022] PUT /identity/v3/projects/e50789d589b544b28e4d53fc75e567bf/users/c6c5c733306740d6abdc21d8bb2f34e7/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:54.691547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-dbe14b21-abfb-4a4b-8b27-3ebe4bb4e4b4 None None] MFA Rules not processed for user `c6c5c733306740d6abdc21d8bb2f34e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:54.692782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dbe14b21-abfb-4a4b-8b27-3ebe4bb4e4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:54.747353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:54.813710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1273/2503] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:54.825309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723527f-e6d3-4812-80f3-9c3e1ae4abda admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:54.827281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8723527f-e6d3-4812-80f3-9c3e1ae4abda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:54.902337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:54.910463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723527f-e6d3-4812-80f3-9c3e1ae4abda admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:54.915258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ede1c-8c3d-47a9-9d71-2598a9cb49e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:54.916050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ede1c-8c3d-47a9-9d71-2598a9cb49e9 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:54.916361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ede1c-8c3d-47a9-9d71-2598a9cb49e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:54.918739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ede1c-8c3d-47a9-9d71-2598a9cb49e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:54.931020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ede1c-8c3d-47a9-9d71-2598a9cb49e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:54.933664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ede1c-8c3d-47a9-9d71-2598a9cb49e9 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:54.951015 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1231/2504] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:54 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:55.090647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe14b21-abfb-4a4b-8b27-3ebe4bb4e4b4 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:55.092552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dbe14b21-abfb-4a4b-8b27-3ebe4bb4e4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:55.108900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe14b21-abfb-4a4b-8b27-3ebe4bb4e4b4 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:55.112852 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ecf62-4d7b-451f-86c7-894dd13b108e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:55.113514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ecf62-4d7b-451f-86c7-894dd13b108e service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:55.113812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ecf62-4d7b-451f-86c7-894dd13b108e service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:55.114078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ecf62-4d7b-451f-86c7-894dd13b108e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:55.184773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ecf62-4d7b-451f-86c7-894dd13b108e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:55.186147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ecf62-4d7b-451f-86c7-894dd13b108e service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:55.199175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1274/2505] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:58.907559 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ede1c-8c3d-47a9-9d71-2598a9cb49e9 service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:58.908928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-021ede1c-8c3d-47a9-9d71-2598a9cb49e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:58.966164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ede1c-8c3d-47a9-9d71-2598a9cb49e9 service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:58.969738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80428502-a504-4ea9-b676-deb221b12e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:58.970370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80428502-a504-4ea9-b676-deb221b12e0d service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:58.970676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80428502-a504-4ea9-b676-deb221b12e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:58.970955 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80428502-a504-4ea9-b676-deb221b12e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:58.972705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-80428502-a504-4ea9-b676-deb221b12e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:58.981954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80428502-a504-4ea9-b676-deb221b12e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:58.983530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80428502-a504-4ea9-b676-deb221b12e0d service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:58.991592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1232/2506] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:55:59.422456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ecf62-4d7b-451f-86c7-894dd13b108e service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:59.493532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ecf62-4d7b-451f-86c7-894dd13b108e service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:59.503027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:59.504332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:59.504828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:59.505265 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] PATH_INFO: `/v3/users/e5afefeb7e564846a6a5604c19143689` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:59.507324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5afefeb7e564846a6a5604c19143689)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:59.511085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:59.569737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5afefeb7e564846a6a5604c19143689'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:59.585697 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:59.587288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5afefeb7e564846a6a5604c19143689'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:59.589060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5afefeb7e564846a6a5604c19143689'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:59.603180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5afefeb7e564846a6a5604c19143689'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:59.617476 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5afefeb7e564846a6a5604c19143689'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:55:59.630329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1275/2507] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:55:59 2022] DELETE /identity/v3/users/e5afefeb7e564846a6a5604c19143689 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:55:59.640125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cec6f2-d5fb-4c02-99d0-51361925081f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:59.640429 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cec6f2-d5fb-4c02-99d0-51361925081f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:59.640698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cec6f2-d5fb-4c02-99d0-51361925081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:59.660688 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-88cec6f2-d5fb-4c02-99d0-51361925081f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:55:59.662155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-88cec6f2-d5fb-4c02-99d0-51361925081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:59.744422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1233/2508] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:55:59.757106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:55:59.758714 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:55:59.837255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892d73-f90c-441c-8d12-7cac97f96a80 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:55:59.841638 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b0243-e787-43a0-bbd1-aa0d62896ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:55:59.842417 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b0243-e787-43a0-bbd1-aa0d62896ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:55:59.842702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b0243-e787-43a0-bbd1-aa0d62896ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:55:59.842979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b0243-e787-43a0-bbd1-aa0d62896ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:55:59.852500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b0243-e787-43a0-bbd1-aa0d62896ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:55:59.853978 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b0243-e787-43a0-bbd1-aa0d62896ed5 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:55:59.868863 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1276/2509] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:00.011281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cec6f2-d5fb-4c02-99d0-51361925081f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:00.012854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-88cec6f2-d5fb-4c02-99d0-51361925081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:00.103184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cec6f2-d5fb-4c02-99d0-51361925081f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:00.111006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeddb84-847e-485a-a9f2-96f9845b67a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:00.111826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeddb84-847e-485a-a9f2-96f9845b67a9 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:00.112305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeddb84-847e-485a-a9f2-96f9845b67a9 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:00.112603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeddb84-847e-485a-a9f2-96f9845b67a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:00.115506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2eeddb84-847e-485a-a9f2-96f9845b67a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:00.131227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeddb84-847e-485a-a9f2-96f9845b67a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:00.133797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeddb84-847e-485a-a9f2-96f9845b67a9 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:00.148680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1234/2510] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:56:00.288054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b0243-e787-43a0-bbd1-aa0d62896ed5 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:00.289755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4c2b0243-e787-43a0-bbd1-aa0d62896ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:00.303881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b0243-e787-43a0-bbd1-aa0d62896ed5 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:00.309423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:00.310296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:00.310603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:00.310881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] PATH_INFO: `/v3/projects/9c0e3e6fcd6d45fc9eac766f9f574cc1` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:00.312083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0e3e6fcd6d45fc9eac766f9f574cc1)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:00.313984 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:00.364040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0e3e6fcd6d45fc9eac766f9f574cc1', 'request_id': 'req-beae032f-5e42-45f9-810b-a0ecabb60296'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.371693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0e3e6fcd6d45fc9eac766f9f574cc1', 'request_id': 'req-beae032f-5e42-45f9-810b-a0ecabb60296'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.381741 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0e3e6fcd6d45fc9eac766f9f574cc1', 'request_id': 'req-beae032f-5e42-45f9-810b-a0ecabb60296'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.393166 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] The token cache is being invalidate because project 9c0e3e6fcd6d45fc9eac766f9f574cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:00.393459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.394113 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.395704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1277/2511] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:00 2022] DELETE /identity/v3/projects/9c0e3e6fcd6d45fc9eac766f9f574cc1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:00.399778 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeddb84-847e-485a-a9f2-96f9845b67a9 service nova] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:00.411274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeddb84-847e-485a-a9f2-96f9845b67a9 service nova] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:00.425548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:00.472716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:00.473592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:00.473896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:00.474169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] PATH_INFO: `/v3/users/c6c5c733306740d6abdc21d8bb2f34e7` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:00.475400 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c5c733306740d6abdc21d8bb2f34e7)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:00.477363 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:00.531320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c5c733306740d6abdc21d8bb2f34e7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.544499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c5c733306740d6abdc21d8bb2f34e7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.545208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c5c733306740d6abdc21d8bb2f34e7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.552305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c5c733306740d6abdc21d8bb2f34e7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.559806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f45f9498-8979-4377-9db9-901af2a2948e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c5c733306740d6abdc21d8bb2f34e7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:00.566255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1235/2512] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:00 2022] DELETE /identity/v3/users/c6c5c733306740d6abdc21d8bb2f34e7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:00.999173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:01.000677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:01.016497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae032f-5e42-45f9-810b-a0ecabb60296 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:01.123246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:01.124136 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.124401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.124730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] PATH_INFO: `/v3/projects/e50789d589b544b28e4d53fc75e567bf` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.126590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50789d589b544b28e4d53fc75e567bf)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:01.128418 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:01.145962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:01.193811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50789d589b544b28e4d53fc75e567bf', 'request_id': 'req-ffc98195-def8-4b1e-bfd5-379d54db43d1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:01.200503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50789d589b544b28e4d53fc75e567bf', 'request_id': 'req-ffc98195-def8-4b1e-bfd5-379d54db43d1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:01.210290 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50789d589b544b28e4d53fc75e567bf', 'request_id': 'req-ffc98195-def8-4b1e-bfd5-379d54db43d1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:01.222305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] The token cache is being invalidate because project e50789d589b544b28e4d53fc75e567bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:01.222869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:01.223635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ffc98195-def8-4b1e-bfd5-379d54db43d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:01.225244 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1278/2513] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:00 2022] DELETE /identity/v3/projects/e50789d589b544b28e4d53fc75e567bf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:01.231808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c6416-c2ba-402a-8492-422dace7e4fe None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.232406 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c6416-c2ba-402a-8492-422dace7e4fe None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.232541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c6416-c2ba-402a-8492-422dace7e4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.252509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e27c6416-c2ba-402a-8492-422dace7e4fe None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:01.253956 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e27c6416-c2ba-402a-8492-422dace7e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:01.321635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1236/2514] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:01.331270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866765e-ef79-41b2-87db-c8aae32f83c1 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.331643 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866765e-ef79-41b2-87db-c8aae32f83c1 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.332303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866765e-ef79-41b2-87db-c8aae32f83c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.356028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5866765e-ef79-41b2-87db-c8aae32f83c1 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:01.357324 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5866765e-ef79-41b2-87db-c8aae32f83c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:01.367008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1279/2515] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:01.372073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c6416-c2ba-402a-8492-422dace7e4fe None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:01.383496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c6416-c2ba-402a-8492-422dace7e4fe None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:01.390989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1cfff-f4cb-401c-91b7-c346f7941430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:01.395125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1cfff-f4cb-401c-91b7-c346f7941430 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.395565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1cfff-f4cb-401c-91b7-c346f7941430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.395858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1cfff-f4cb-401c-91b7-c346f7941430 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.396637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1cfff-f4cb-401c-91b7-c346f7941430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:01.397905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1cfff-f4cb-401c-91b7-c346f7941430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:01.400276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1cfff-f4cb-401c-91b7-c346f7941430 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:01.418427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1237/2516] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:01.422767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866765e-ef79-41b2-87db-c8aae32f83c1 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:01.432221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866765e-ef79-41b2-87db-c8aae32f83c1 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:01.436987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ad3cb-5fbe-463a-b447-20ff5fd74be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:01.437642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad3cb-5fbe-463a-b447-20ff5fd74be9 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.437922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad3cb-5fbe-463a-b447-20ff5fd74be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.438199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad3cb-5fbe-463a-b447-20ff5fd74be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.438924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ad3cb-5fbe-463a-b447-20ff5fd74be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:01.440921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ad3cb-5fbe-463a-b447-20ff5fd74be9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:01.468346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1280/2517] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:01 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:01.472270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1cfff-f4cb-401c-91b7-c346f7941430 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:01.482237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1cfff-f4cb-401c-91b7-c346f7941430 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:01.503259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:01.542595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804754c-7130-4202-aa26-d0954198aedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:01.543266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804754c-7130-4202-aa26-d0954198aedc admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.543570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804754c-7130-4202-aa26-d0954198aedc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.543828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804754c-7130-4202-aa26-d0954198aedc admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.544513 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804754c-7130-4202-aa26-d0954198aedc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:01.546464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804754c-7130-4202-aa26-d0954198aedc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:01.566198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1238/2518] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:01 2022] POST /identity/v3/users => generated 305 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:01.570307 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ad3cb-5fbe-463a-b447-20ff5fd74be9 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:01.580602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ad3cb-5fbe-463a-b447-20ff5fd74be9 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:01.585098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335858c4-2d21-42db-87c6-9d44f06cd0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:01.585747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335858c4-2d21-42db-87c6-9d44f06cd0bf admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.586029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335858c4-2d21-42db-87c6-9d44f06cd0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.586305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335858c4-2d21-42db-87c6-9d44f06cd0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.587048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335858c4-2d21-42db-87c6-9d44f06cd0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:01.588916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335858c4-2d21-42db-87c6-9d44f06cd0bf admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:01.599430 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1281/2519] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:01.603498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804754c-7130-4202-aa26-d0954198aedc admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:01.614319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804754c-7130-4202-aa26-d0954198aedc admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:01.619231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dfd4a-d8c9-4a54-b565-ff1d2f26c0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:01.620455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dfd4a-d8c9-4a54-b565-ff1d2f26c0ba admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.620738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dfd4a-d8c9-4a54-b565-ff1d2f26c0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.621013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dfd4a-d8c9-4a54-b565-ff1d2f26c0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.622287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dfd4a-d8c9-4a54-b565-ff1d2f26c0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:01.624476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dfd4a-d8c9-4a54-b565-ff1d2f26c0ba admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:01.640984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1239/2520] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:01.642182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335858c4-2d21-42db-87c6-9d44f06cd0bf admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:01.652592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335858c4-2d21-42db-87c6-9d44f06cd0bf admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:01.657374 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3c6f-4da5-446c-8061-bcab2666633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:01.658257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3c6f-4da5-446c-8061-bcab2666633a admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.658574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3c6f-4da5-446c-8061-bcab2666633a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.658842 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3c6f-4da5-446c-8061-bcab2666633a admin admin] PATH_INFO: `/v3/projects/3aaf36dd7c5f48f882eef1fd9329869a/users/bcf9952dc9a740ba963d031250492e41/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.675798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e3c6f-4da5-446c-8061-bcab2666633a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aaf36dd7c5f48f882eef1fd9329869a, user_id=bcf9952dc9a740ba963d031250492e41, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:01.678509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e3c6f-4da5-446c-8061-bcab2666633a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:01.692563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1282/2521] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:01 2022] PUT /identity/v3/projects/3aaf36dd7c5f48f882eef1fd9329869a/users/bcf9952dc9a740ba963d031250492e41/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:56:01.702934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b5047-a8af-45d3-95aa-24c93cb4781b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.703245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b5047-a8af-45d3-95aa-24c93cb4781b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.703548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b5047-a8af-45d3-95aa-24c93cb4781b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.731031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d78b5047-a8af-45d3-95aa-24c93cb4781b None None] MFA Rules not processed for user `bcf9952dc9a740ba963d031250492e41`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:01.732224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d78b5047-a8af-45d3-95aa-24c93cb4781b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:01.795177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1240/2522] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:01.799635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3c6f-4da5-446c-8061-bcab2666633a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:01.862033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3c6f-4da5-446c-8061-bcab2666633a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:01.866737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519deb-2098-4d22-b24c-e44fb118a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:01.867504 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519deb-2098-4d22-b24c-e44fb118a3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.867781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519deb-2098-4d22-b24c-e44fb118a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.868054 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519deb-2098-4d22-b24c-e44fb118a3d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.868749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08519deb-2098-4d22-b24c-e44fb118a3d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:01.870689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08519deb-2098-4d22-b24c-e44fb118a3d6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:01.895577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1283/2523] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:01 2022] POST /identity/v3/projects => generated 407 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:01.899622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b5047-a8af-45d3-95aa-24c93cb4781b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:01.911989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b5047-a8af-45d3-95aa-24c93cb4781b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:01.989707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb3e84-154d-4abd-ab1c-d266d3419116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:01.990375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb3e84-154d-4abd-ab1c-d266d3419116 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:01.990684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb3e84-154d-4abd-ab1c-d266d3419116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:01.990957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb3e84-154d-4abd-ab1c-d266d3419116 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:01.991648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb3e84-154d-4abd-ab1c-d266d3419116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:01.993582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb3e84-154d-4abd-ab1c-d266d3419116 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:02.024442 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1241/2524] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:01 2022] POST /identity/v3/users => generated 310 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:02.028979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519deb-2098-4d22-b24c-e44fb118a3d6 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:02.040020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519deb-2098-4d22-b24c-e44fb118a3d6 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:02.044883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dba739-7765-45dd-8e43-609d2002bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:02.045564 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dba739-7765-45dd-8e43-609d2002bc3d admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:02.046320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dba739-7765-45dd-8e43-609d2002bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:02.046320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dba739-7765-45dd-8e43-609d2002bc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:02.047198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dba739-7765-45dd-8e43-609d2002bc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:02.048611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dba739-7765-45dd-8e43-609d2002bc3d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:02.062413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1284/2525] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:56:02.065465 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb3e84-154d-4abd-ab1c-d266d3419116 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:02.076752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb3e84-154d-4abd-ab1c-d266d3419116 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:02.082786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15e1d-c164-4d44-a54e-6e7fbd417521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:02.083736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15e1d-c164-4d44-a54e-6e7fbd417521 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:02.084018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15e1d-c164-4d44-a54e-6e7fbd417521 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:02.084300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b15e1d-c164-4d44-a54e-6e7fbd417521 admin admin] PATH_INFO: `/v3/projects/e0b0a96b169d44bca0ada10b50cc97b1/users/2201580925e04d21bff9b0214209697d/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:02.106939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15e1d-c164-4d44-a54e-6e7fbd417521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b0a96b169d44bca0ada10b50cc97b1, user_id=2201580925e04d21bff9b0214209697d, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:02.109733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b15e1d-c164-4d44-a54e-6e7fbd417521 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:02.119360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:02.127615 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1242/2526] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:02 2022] PUT /identity/v3/projects/e0b0a96b169d44bca0ada10b50cc97b1/users/2201580925e04d21bff9b0214209697d/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:02.131773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dba739-7765-45dd-8e43-609d2002bc3d admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:02.142695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dba739-7765-45dd-8e43-609d2002bc3d admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:02.146923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:02.226335 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae810618-59f9-43c4-9893-1ae613524fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:02.227205 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae810618-59f9-43c4-9893-1ae613524fcc admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:02.227372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae810618-59f9-43c4-9893-1ae613524fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:02.227641 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae810618-59f9-43c4-9893-1ae613524fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:02.229405 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae810618-59f9-43c4-9893-1ae613524fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:02.231986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae810618-59f9-43c4-9893-1ae613524fcc admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:02.243097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1285/2527] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:02.247736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15e1d-c164-4d44-a54e-6e7fbd417521 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:02.258548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b15e1d-c164-4d44-a54e-6e7fbd417521 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:02.264651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3dd68-e738-4810-b35c-b4e30f7a838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:02.265554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3dd68-e738-4810-b35c-b4e30f7a838c admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:02.265838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3dd68-e738-4810-b35c-b4e30f7a838c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:02.266116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3dd68-e738-4810-b35c-b4e30f7a838c admin admin] PATH_INFO: `/v3/projects/e0b0a96b169d44bca0ada10b50cc97b1/users/2201580925e04d21bff9b0214209697d/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:02.268955 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3dd68-e738-4810-b35c-b4e30f7a838c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b0a96b169d44bca0ada10b50cc97b1, user_id=2201580925e04d21bff9b0214209697d, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:02.271698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3dd68-e738-4810-b35c-b4e30f7a838c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:02.283031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1243/2528] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:02 2022] PUT /identity/v3/projects/e0b0a96b169d44bca0ada10b50cc97b1/users/2201580925e04d21bff9b0214209697d/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:02.293658 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d79eb-5f7b-490c-9cd2-f05789715413 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:02.293946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d79eb-5f7b-490c-9cd2-f05789715413 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:02.294262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d79eb-5f7b-490c-9cd2-f05789715413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:02.325898 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-585d79eb-5f7b-490c-9cd2-f05789715413 None None] MFA Rules not processed for user `2201580925e04d21bff9b0214209697d`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:02.327151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-585d79eb-5f7b-490c-9cd2-f05789715413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:02.399379 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1286/2529] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:02.410900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3dd68-e738-4810-b35c-b4e30f7a838c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:02.412937 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5cf3dd68-e738-4810-b35c-b4e30f7a838c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:02.493568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3dd68-e738-4810-b35c-b4e30f7a838c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:02.514411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ad91e-6fe9-4b54-9983-b807c8e2a44b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:02.515234 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ad91e-6fe9-4b54-9983-b807c8e2a44b service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:02.517249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ad91e-6fe9-4b54-9983-b807c8e2a44b service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:02.517770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ad91e-6fe9-4b54-9983-b807c8e2a44b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:02.530419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ad91e-6fe9-4b54-9983-b807c8e2a44b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:02.532035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ad91e-6fe9-4b54-9983-b807c8e2a44b service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:02.545068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1244/2530] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:02 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:02.718340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d79eb-5f7b-490c-9cd2-f05789715413 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:02.728575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d79eb-5f7b-490c-9cd2-f05789715413 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:02.732720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126d2dc-79ee-49e1-966c-79caaf4458a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:02.733388 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126d2dc-79ee-49e1-966c-79caaf4458a5 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:02.733673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126d2dc-79ee-49e1-966c-79caaf4458a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:02.733948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126d2dc-79ee-49e1-966c-79caaf4458a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:02.819252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126d2dc-79ee-49e1-966c-79caaf4458a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:02.820970 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126d2dc-79ee-49e1-966c-79caaf4458a5 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:02.830841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1287/2531] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:03.469719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dcff3-44bb-4a98-82e1-1c395ba054a2 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:03.470275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dcff3-44bb-4a98-82e1-1c395ba054a2 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:03.470632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dcff3-44bb-4a98-82e1-1c395ba054a2 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:03.472192 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1245/2532] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:56:03.478340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9de229-fade-4326-b06c-aea7b04a71f2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:03.479447 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9de229-fade-4326-b06c-aea7b04a71f2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:03.479753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9de229-fade-4326-b06c-aea7b04a71f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:03.499369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-da9de229-fade-4326-b06c-aea7b04a71f2 None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:03.500574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-da9de229-fade-4326-b06c-aea7b04a71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:03.524762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:03.581613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1288/2533] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:56:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:03.594059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dcff3-44bb-4a98-82e1-1c395ba054a2 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:03.595957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ae9dcff3-44bb-4a98-82e1-1c395ba054a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:03.667554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dcff3-44bb-4a98-82e1-1c395ba054a2 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:03.671151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173f7c3-feb7-40f7-aab1-aa1527fbcf8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb359ac9b084b38b77923219f42f655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:03.671997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173f7c3-feb7-40f7-aab1-aa1527fbcf8d service glance] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:03.672160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173f7c3-feb7-40f7-aab1-aa1527fbcf8d service glance] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:03.672335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173f7c3-feb7-40f7-aab1-aa1527fbcf8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:03.682878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173f7c3-feb7-40f7-aab1-aa1527fbcf8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:03.684224 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173f7c3-feb7-40f7-aab1-aa1527fbcf8d service glance] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:03.695543 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1246/2534] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:03.763161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b0987-dd6f-437f-b358-c5cb747a760f None None] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:03.763446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b0987-dd6f-437f-b358-c5cb747a760f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:03.763722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b0987-dd6f-437f-b358-c5cb747a760f None None] PATH_INFO: `/` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:03.765485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1289/2535] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:56:03.769936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae228c1-e018-42f6-bea4-22dd99891f60 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:03.770230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae228c1-e018-42f6-bea4-22dd99891f60 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:03.770554 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae228c1-e018-42f6-bea4-22dd99891f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:03.789136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2ae228c1-e018-42f6-bea4-22dd99891f60 None None] MFA Rules not processed for user `e11a8567e1254a0080cbe74efe0127f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:03.790319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2ae228c1-e018-42f6-bea4-22dd99891f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:03.842846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1247/2536] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:56:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:03.855014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b0987-dd6f-437f-b358-c5cb747a760f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:03.856961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e54b0987-dd6f-437f-b358-c5cb747a760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:03.869977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b0987-dd6f-437f-b358-c5cb747a760f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:03.873446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d05e5-0b7b-4f15-b1c8-8ecb8b3dfb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:03.874073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d05e5-0b7b-4f15-b1c8-8ecb8b3dfb4e service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:03.874354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d05e5-0b7b-4f15-b1c8-8ecb8b3dfb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:03.874653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d05e5-0b7b-4f15-b1c8-8ecb8b3dfb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:03.881897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d05e5-0b7b-4f15-b1c8-8ecb8b3dfb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:03.883334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d05e5-0b7b-4f15-b1c8-8ecb8b3dfb4e service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:03.891552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1290/2537] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:03.975607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d893e-60cb-4408-a433-f76bf81dc7f1 None None] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:03.975897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d893e-60cb-4408-a433-f76bf81dc7f1 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:03.976177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d893e-60cb-4408-a433-f76bf81dc7f1 None None] PATH_INFO: `/` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:03.977556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1248/2538] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jun 16 18:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 18:56:03.982690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aa959-31a1-49b6-9dc4-a333cc625f25 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:03.983046 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aa959-31a1-49b6-9dc4-a333cc625f25 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:03.983393 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aa959-31a1-49b6-9dc4-a333cc625f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:04.002615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-fa2aa959-31a1-49b6-9dc4-a333cc625f25 None None] MFA Rules not processed for user `6cba70fa423e413a9222021116ff5718`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:04.003801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-fa2aa959-31a1-49b6-9dc4-a333cc625f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:04.015685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1291/2539] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jun 16 18:56:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:04.029916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d893e-60cb-4408-a433-f76bf81dc7f1 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:04.042317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d893e-60cb-4408-a433-f76bf81dc7f1 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:04.047464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3f5fe-e4b5-4a66-9222-71d0cf54d486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:04.047464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3f5fe-e4b5-4a66-9222-71d0cf54d486 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:04.047464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3f5fe-e4b5-4a66-9222-71d0cf54d486 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:04.047809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3f5fe-e4b5-4a66-9222-71d0cf54d486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:04.059648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3f5fe-e4b5-4a66-9222-71d0cf54d486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:04.061235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3f5fe-e4b5-4a66-9222-71d0cf54d486 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:04.073233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1249/2540] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:04.134364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aa959-31a1-49b6-9dc4-a333cc625f25 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:04.136482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-fa2aa959-31a1-49b6-9dc4-a333cc625f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:04.214045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aa959-31a1-49b6-9dc4-a333cc625f25 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:04.219337 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a838e-0a48-4b16-887d-03bef9f274ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:04.220021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a838e-0a48-4b16-887d-03bef9f274ae service placement] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:04.220306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a838e-0a48-4b16-887d-03bef9f274ae service placement] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:04.220605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a838e-0a48-4b16-887d-03bef9f274ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:04.222437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f20a838e-0a48-4b16-887d-03bef9f274ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:04.235205 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a838e-0a48-4b16-887d-03bef9f274ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:04.236866 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a838e-0a48-4b16-887d-03bef9f274ae service placement] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:04.248019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1292/2541] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:06.387707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3f5fe-e4b5-4a66-9222-71d0cf54d486 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:06.397487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3f5fe-e4b5-4a66-9222-71d0cf54d486 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:06.401684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:06.402318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:06.402638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:06.402912 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:06.404655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:06.412376 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaa155-8922-43c6-9464-d77e15b40fc6 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:06.412878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaa155-8922-43c6-9464-d77e15b40fc6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:06.412977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaa155-8922-43c6-9464-d77e15b40fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:06.431599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-72aaa155-8922-43c6-9464-d77e15b40fc6 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:06.432848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-72aaa155-8922-43c6-9464-d77e15b40fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:06.433695 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:06.473332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:06.474930 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:06.485780 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1250/2542] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:06.489614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1293/2543] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:56:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:06.503574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:06.505244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:06.579827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938929e-1daa-4862-bf42-905b9b801085 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:06.584760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61415620-e5fb-4606-9ab4-e4e9f09352ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:06.585754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61415620-e5fb-4606-9ab4-e4e9f09352ee service swift] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:06.586035 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61415620-e5fb-4606-9ab4-e4e9f09352ee service swift] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:06.586308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61415620-e5fb-4606-9ab4-e4e9f09352ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:06.595704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61415620-e5fb-4606-9ab4-e4e9f09352ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:06.597303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61415620-e5fb-4606-9ab4-e4e9f09352ee service swift] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:06.606026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1251/2544] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:56:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:56:08.455069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaa155-8922-43c6-9464-d77e15b40fc6 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:08.469873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaa155-8922-43c6-9464-d77e15b40fc6 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:08.489367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:08.490475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:08.490838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:08.491117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] PATH_INFO: `/v3/users/bcf9952dc9a740ba963d031250492e41` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:08.492780 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf9952dc9a740ba963d031250492e41)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:08.495070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:08.583617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:08.628053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf9952dc9a740ba963d031250492e41'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:08.655990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf9952dc9a740ba963d031250492e41'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:08.656752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf9952dc9a740ba963d031250492e41'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:08.668410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf9952dc9a740ba963d031250492e41'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:08.689086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf9952dc9a740ba963d031250492e41'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:08.708484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1294/2545] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:08 2022] DELETE /identity/v3/users/bcf9952dc9a740ba963d031250492e41 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:08.710553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c381da-5595-474c-a6d9-ef69b4258f8d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:08.712334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c381da-5595-474c-a6d9-ef69b4258f8d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:08.713312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c381da-5595-474c-a6d9-ef69b4258f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:08.743357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-09c381da-5595-474c-a6d9-ef69b4258f8d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:08.746114 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-09c381da-5595-474c-a6d9-ef69b4258f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:08.880774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1252/2546] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:08.887775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:08.889347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:09.016617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c381da-5595-474c-a6d9-ef69b4258f8d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:09.018198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-09c381da-5595-474c-a6d9-ef69b4258f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:09.018745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d79d4-4e73-49e3-83ce-15fa11424ce8 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:09.023243 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf12c97-004c-43bf-b860-c97f68458a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:09.024122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12c97-004c-43bf-b860-c97f68458a23 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:09.024511 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12c97-004c-43bf-b860-c97f68458a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:09.024892 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12c97-004c-43bf-b860-c97f68458a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:09.052714 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf12c97-004c-43bf-b860-c97f68458a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:09.054484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf12c97-004c-43bf-b860-c97f68458a23 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:09.077302 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1295/2547] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:09.124076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:09.157593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c381da-5595-474c-a6d9-ef69b4258f8d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:09.183279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247da10-28ea-4080-9844-1ade29b8c6a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:09.184033 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247da10-28ea-4080-9844-1ade29b8c6a4 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:09.184427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247da10-28ea-4080-9844-1ade29b8c6a4 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:09.184974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247da10-28ea-4080-9844-1ade29b8c6a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:09.189992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c247da10-28ea-4080-9844-1ade29b8c6a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:09.229278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247da10-28ea-4080-9844-1ade29b8c6a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:09.231871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247da10-28ea-4080-9844-1ade29b8c6a4 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:09.249410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1253/2548] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:09.676371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf12c97-004c-43bf-b860-c97f68458a23 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:09.678118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7cf12c97-004c-43bf-b860-c97f68458a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:09.696872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf12c97-004c-43bf-b860-c97f68458a23 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:09.702520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:09.703395 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:09.703677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:09.703953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] PATH_INFO: `/v3/projects/3aaf36dd7c5f48f882eef1fd9329869a` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:09.705156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aaf36dd7c5f48f882eef1fd9329869a)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:09.707488 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:09.810306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aaf36dd7c5f48f882eef1fd9329869a', 'request_id': 'req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:09.820943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aaf36dd7c5f48f882eef1fd9329869a', 'request_id': 'req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:09.840903 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aaf36dd7c5f48f882eef1fd9329869a', 'request_id': 'req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:09.864339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] The token cache is being invalidate because project 3aaf36dd7c5f48f882eef1fd9329869a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:09.870693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:09.874854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:09.876827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1296/2549] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:09 2022] DELETE /identity/v3/projects/3aaf36dd7c5f48f882eef1fd9329869a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:09.880888 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247da10-28ea-4080-9844-1ade29b8c6a4 service nova] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:09.894575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247da10-28ea-4080-9844-1ade29b8c6a4 service nova] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:10.062781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:10.064991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:10.065563 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:10.066129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] PATH_INFO: `/v3/users/2201580925e04d21bff9b0214209697d` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:10.071486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2201580925e04d21bff9b0214209697d)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:10.082597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:10.259086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2201580925e04d21bff9b0214209697d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:10.310951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2201580925e04d21bff9b0214209697d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:10.312714 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2201580925e04d21bff9b0214209697d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:10.340633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2201580925e04d21bff9b0214209697d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:10.366265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-69220f14-a435-4be7-b306-2844d3c6661c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2201580925e04d21bff9b0214209697d'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:10.388433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1254/2550] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:09 2022] DELETE /identity/v3/users/2201580925e04d21bff9b0214209697d => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:11.616325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:11.618042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:11.639351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f50d-a70b-4ca2-aaa5-21f7afb84784 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:11.770276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:11.828718 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:11.829725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:11.830112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:11.830528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] PATH_INFO: `/v3/projects/e0b0a96b169d44bca0ada10b50cc97b1` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:11.832167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b0a96b169d44bca0ada10b50cc97b1)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:11.834873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:11.976147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b0a96b169d44bca0ada10b50cc97b1', 'request_id': 'req-ab917852-b6cb-4474-8ca9-58b3a079dcb8'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:12.010182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b0a96b169d44bca0ada10b50cc97b1', 'request_id': 'req-ab917852-b6cb-4474-8ca9-58b3a079dcb8'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:12.027869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b0a96b169d44bca0ada10b50cc97b1', 'request_id': 'req-ab917852-b6cb-4474-8ca9-58b3a079dcb8'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:12.046634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] The token cache is being invalidate because project e0b0a96b169d44bca0ada10b50cc97b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:12.047002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:12.047692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ab917852-b6cb-4474-8ca9-58b3a079dcb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:12.049687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1297/2551] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:11 2022] DELETE /identity/v3/projects/e0b0a96b169d44bca0ada10b50cc97b1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:12.055813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e66e9-4af3-435a-8d02-f7af4da2224b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:12.056342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e66e9-4af3-435a-8d02-f7af4da2224b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:12.056603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e66e9-4af3-435a-8d02-f7af4da2224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:12.083006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-128e66e9-4af3-435a-8d02-f7af4da2224b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:12.084424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-128e66e9-4af3-435a-8d02-f7af4da2224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:12.195726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:12.242715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1255/2552] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:12.251134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef46b9-dbf3-4fb7-8bc5-7abb4a8534e2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:12.251906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef46b9-dbf3-4fb7-8bc5-7abb4a8534e2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:12.252421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef46b9-dbf3-4fb7-8bc5-7abb4a8534e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:12.332486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-70ef46b9-dbf3-4fb7-8bc5-7abb4a8534e2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:12.333869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-70ef46b9-dbf3-4fb7-8bc5-7abb4a8534e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:12.359156 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1298/2553] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:12.360489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e66e9-4af3-435a-8d02-f7af4da2224b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:12.374501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e66e9-4af3-435a-8d02-f7af4da2224b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:12.379827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e5a57-568e-45a7-9453-c389d4f4cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:12.380542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e5a57-568e-45a7-9453-c389d4f4cddc admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:12.380921 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e5a57-568e-45a7-9453-c389d4f4cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:12.381291 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e5a57-568e-45a7-9453-c389d4f4cddc admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:12.382125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e5a57-568e-45a7-9453-c389d4f4cddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:12.382579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e5a57-568e-45a7-9453-c389d4f4cddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:12.384328 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e5a57-568e-45a7-9453-c389d4f4cddc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:12.401710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1256/2554] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:56:12.403147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef46b9-dbf3-4fb7-8bc5-7abb4a8534e2 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:12.420987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef46b9-dbf3-4fb7-8bc5-7abb4a8534e2 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:12.428530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bdcbf-acef-4e46-8b1a-c7e619ec9ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:12.429033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bdcbf-acef-4e46-8b1a-c7e619ec9ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:12.429346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bdcbf-acef-4e46-8b1a-c7e619ec9ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:12.429586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bdcbf-acef-4e46-8b1a-c7e619ec9ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:12.430272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bdcbf-acef-4e46-8b1a-c7e619ec9ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:12.433524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bdcbf-acef-4e46-8b1a-c7e619ec9ec8 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:12.478006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1299/2555] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:12 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:12.482237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e5a57-568e-45a7-9453-c389d4f4cddc admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:12.495110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e5a57-568e-45a7-9453-c389d4f4cddc admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:12.684605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8e3a-a397-4f04-8d63-9d92a598475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:12.685499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8e3a-a397-4f04-8d63-9d92a598475f admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:12.686176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8e3a-a397-4f04-8d63-9d92a598475f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:12.686649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8e3a-a397-4f04-8d63-9d92a598475f admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:12.687545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d8e3a-a397-4f04-8d63-9d92a598475f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:12.690522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d8e3a-a397-4f04-8d63-9d92a598475f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:12.725546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1257/2556] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:12 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:12.730160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bdcbf-acef-4e46-8b1a-c7e619ec9ec8 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:12.752627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bdcbf-acef-4e46-8b1a-c7e619ec9ec8 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:12.763135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff784893-a892-444a-a991-9109b6a2f797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:12.764145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff784893-a892-444a-a991-9109b6a2f797 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:12.765975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff784893-a892-444a-a991-9109b6a2f797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:12.766633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff784893-a892-444a-a991-9109b6a2f797 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:12.768332 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff784893-a892-444a-a991-9109b6a2f797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:12.773196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff784893-a892-444a-a991-9109b6a2f797 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:12.807458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1300/2557] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:12.810235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8e3a-a397-4f04-8d63-9d92a598475f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:12.822724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8e3a-a397-4f04-8d63-9d92a598475f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:12.840534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37628e86-e10d-441b-8be0-07cd4b620ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:12.841356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37628e86-e10d-441b-8be0-07cd4b620ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:12.841824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37628e86-e10d-441b-8be0-07cd4b620ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:12.842164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37628e86-e10d-441b-8be0-07cd4b620ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:12.842938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37628e86-e10d-441b-8be0-07cd4b620ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:12.854209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37628e86-e10d-441b-8be0-07cd4b620ae4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:12.876900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1258/2558] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:12.881959 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff784893-a892-444a-a991-9109b6a2f797 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:12.896509 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff784893-a892-444a-a991-9109b6a2f797 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:12.907399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7c17a-0568-4478-ad3d-eebf7e58f412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:12.907399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7c17a-0568-4478-ad3d-eebf7e58f412 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:12.907399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7c17a-0568-4478-ad3d-eebf7e58f412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:12.912368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7c17a-0568-4478-ad3d-eebf7e58f412 admin admin] PATH_INFO: `/v3/projects/d0cb97719e694c879126f2a708fec563/users/52b32810724c46778ae6bd6e309f3524/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:12.967451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7c17a-0568-4478-ad3d-eebf7e58f412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0cb97719e694c879126f2a708fec563, user_id=52b32810724c46778ae6bd6e309f3524, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:12.971273 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7c17a-0568-4478-ad3d-eebf7e58f412 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:13.053358 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1301/2559] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:12 2022] PUT /identity/v3/projects/d0cb97719e694c879126f2a708fec563/users/52b32810724c46778ae6bd6e309f3524/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:13.069102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b765e-11df-446d-b555-6a88beebb8a9 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:13.070251 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b765e-11df-446d-b555-6a88beebb8a9 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:13.070800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b765e-11df-446d-b555-6a88beebb8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:13.142330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-dd5b765e-11df-446d-b555-6a88beebb8a9 None None] MFA Rules not processed for user `52b32810724c46778ae6bd6e309f3524`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:13.143678 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dd5b765e-11df-446d-b555-6a88beebb8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:13.155121 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7c17a-0568-4478-ad3d-eebf7e58f412 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:13.157149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d1b7c17a-0568-4478-ad3d-eebf7e58f412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:13.330104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:13.337129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1259/2560] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:13.342705 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7c17a-0568-4478-ad3d-eebf7e58f412 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:13.355180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b765e-11df-446d-b555-6a88beebb8a9 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:13.357275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:13.358063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dd5b765e-11df-446d-b555-6a88beebb8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:13.358188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:13.361295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:13.362790 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] PATH_INFO: `/v3/users/d3b7491e67544485bc964386ed5946bd` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:13.364948 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b7491e67544485bc964386ed5946bd)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:13.372849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:13.511922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b7491e67544485bc964386ed5946bd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:13.538345 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b7491e67544485bc964386ed5946bd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:13.541228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b7491e67544485bc964386ed5946bd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:13.558624 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b7491e67544485bc964386ed5946bd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:13.558869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b765e-11df-446d-b555-6a88beebb8a9 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:13.572822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf219aa1-4dd5-4924-84f6-f6e732f55785 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb359ac9b084b38b77923219f42f655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:13.573974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf219aa1-4dd5-4924-84f6-f6e732f55785 service glance] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:13.574404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf219aa1-4dd5-4924-84f6-f6e732f55785 service glance] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:13.574999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf219aa1-4dd5-4924-84f6-f6e732f55785 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:13.577769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b7491e67544485bc964386ed5946bd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:13.582320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-bf219aa1-4dd5-4924-84f6-f6e732f55785 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:13.598702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1302/2561] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:13 2022] DELETE /identity/v3/users/d3b7491e67544485bc964386ed5946bd => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:56:13.604204 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:13.616279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf219aa1-4dd5-4924-84f6-f6e732f55785 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:13.618285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf219aa1-4dd5-4924-84f6-f6e732f55785 service glance] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:13.665857 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1260/2562] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:14.005815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:14.011052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:14.114426 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fb3e1-edc6-4eb9-99f6-7c92b7aa6315 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:14.120085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:14.121052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:14.121423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:14.121765 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] PATH_INFO: `/v3/projects/3c25c3284c5c43a4b3063ef483e24dfb` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:14.123513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c25c3284c5c43a4b3063ef483e24dfb)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:14.125755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:14.215771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c25c3284c5c43a4b3063ef483e24dfb', 'request_id': 'req-92c74d90-f480-49c6-977b-9ff7e2c6edcd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:14.236811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c25c3284c5c43a4b3063ef483e24dfb', 'request_id': 'req-92c74d90-f480-49c6-977b-9ff7e2c6edcd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:14.252662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c25c3284c5c43a4b3063ef483e24dfb', 'request_id': 'req-92c74d90-f480-49c6-977b-9ff7e2c6edcd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:14.278095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] The token cache is being invalidate because project 3c25c3284c5c43a4b3063ef483e24dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:14.278695 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:14.279808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-92c74d90-f480-49c6-977b-9ff7e2c6edcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:14.282729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1303/2563] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:14 2022] DELETE /identity/v3/projects/3c25c3284c5c43a4b3063ef483e24dfb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:14.287658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516818d-2b47-475d-9569-4d9dc2167425 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:14.288200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516818d-2b47-475d-9569-4d9dc2167425 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:14.288200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516818d-2b47-475d-9569-4d9dc2167425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:14.332104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-0516818d-2b47-475d-9569-4d9dc2167425 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:14.333419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0516818d-2b47-475d-9569-4d9dc2167425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:14.503795 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1261/2564] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:14.509071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502dbd-7550-436a-b7a7-7425dfa9b454 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:14.509394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502dbd-7550-436a-b7a7-7425dfa9b454 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:14.509692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db502dbd-7550-436a-b7a7-7425dfa9b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:14.524288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:14.531151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-db502dbd-7550-436a-b7a7-7425dfa9b454 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:14.533532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-db502dbd-7550-436a-b7a7-7425dfa9b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:14.545047 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1304/2565] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:14.549925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516818d-2b47-475d-9569-4d9dc2167425 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:14.561395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516818d-2b47-475d-9569-4d9dc2167425 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:14.566815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522e789-2429-471e-880b-0dd62f6c9c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:14.567684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522e789-2429-471e-880b-0dd62f6c9c59 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:14.568076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522e789-2429-471e-880b-0dd62f6c9c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:14.568471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522e789-2429-471e-880b-0dd62f6c9c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:14.569673 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522e789-2429-471e-880b-0dd62f6c9c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:14.570091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522e789-2429-471e-880b-0dd62f6c9c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:14.572134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522e789-2429-471e-880b-0dd62f6c9c59 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:14.596319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db502dbd-7550-436a-b7a7-7425dfa9b454 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:14.597084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1262/2566] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:14.618901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db502dbd-7550-436a-b7a7-7425dfa9b454 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:14.648506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ac0e0-7e99-4292-b1f0-5c14e4971263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:14.650665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ac0e0-7e99-4292-b1f0-5c14e4971263 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:14.651275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ac0e0-7e99-4292-b1f0-5c14e4971263 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:14.651840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ac0e0-7e99-4292-b1f0-5c14e4971263 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:14.652832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ac0e0-7e99-4292-b1f0-5c14e4971263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:14.656707 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ac0e0-7e99-4292-b1f0-5c14e4971263 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:14.767258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1305/2567] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:14 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:14.771212 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522e789-2429-471e-880b-0dd62f6c9c59 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:14.786714 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522e789-2429-471e-880b-0dd62f6c9c59 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:14.927353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa3de4-7119-463f-8818-6a594bf9e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:14.928041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa3de4-7119-463f-8818-6a594bf9e0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:14.928321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa3de4-7119-463f-8818-6a594bf9e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:14.928593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa3de4-7119-463f-8818-6a594bf9e0b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:14.929289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa3de4-7119-463f-8818-6a594bf9e0b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:14.931333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa3de4-7119-463f-8818-6a594bf9e0b4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:14.987930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ac0e0-7e99-4292-b1f0-5c14e4971263 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:14.988496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1263/2568] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:14 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:15.008770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ac0e0-7e99-4292-b1f0-5c14e4971263 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.022923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dabd5-b370-4b99-9e97-b4c89931989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.024004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dabd5-b370-4b99-9e97-b4c89931989b admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.024549 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dabd5-b370-4b99-9e97-b4c89931989b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.027222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dabd5-b370-4b99-9e97-b4c89931989b admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.029470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0dabd5-b370-4b99-9e97-b4c89931989b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.031655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0dabd5-b370-4b99-9e97-b4c89931989b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.046274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1306/2569] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:56:15.050131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa3de4-7119-463f-8818-6a594bf9e0b4 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:15.063818 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa3de4-7119-463f-8818-6a594bf9e0b4 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.075271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c64607-b1ae-4fdd-a872-99aa4f1da16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.076102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c64607-b1ae-4fdd-a872-99aa4f1da16d admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.076380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c64607-b1ae-4fdd-a872-99aa4f1da16d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.076665 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c64607-b1ae-4fdd-a872-99aa4f1da16d admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.077418 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c64607-b1ae-4fdd-a872-99aa4f1da16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.079309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c64607-b1ae-4fdd-a872-99aa4f1da16d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.097440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1264/2570] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:15.098986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dabd5-b370-4b99-9e97-b4c89931989b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:15.113153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dabd5-b370-4b99-9e97-b4c89931989b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.120327 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af041f8d-d197-45fe-b2a3-5ad0363464df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.121472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af041f8d-d197-45fe-b2a3-5ad0363464df admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.121919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af041f8d-d197-45fe-b2a3-5ad0363464df admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.125416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af041f8d-d197-45fe-b2a3-5ad0363464df admin admin] PATH_INFO: `/v3/projects/cd12482f019c4cfc832693c0f11c2fcf/users/f20cf592df6540d28f88cbd61f12cf07/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.160749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af041f8d-d197-45fe-b2a3-5ad0363464df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd12482f019c4cfc832693c0f11c2fcf, user_id=f20cf592df6540d28f88cbd61f12cf07, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.163747 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af041f8d-d197-45fe-b2a3-5ad0363464df admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.180282 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1307/2571] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:15 2022] PUT /identity/v3/projects/cd12482f019c4cfc832693c0f11c2fcf/users/f20cf592df6540d28f88cbd61f12cf07/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:15.191091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115652b-46a0-404d-a815-8b5f626da3eb None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.191382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115652b-46a0-404d-a815-8b5f626da3eb None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.191660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115652b-46a0-404d-a815-8b5f626da3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.218063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a115652b-46a0-404d-a815-8b5f626da3eb None None] MFA Rules not processed for user `f20cf592df6540d28f88cbd61f12cf07`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:15.219304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a115652b-46a0-404d-a815-8b5f626da3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:15.271928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:15.294573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1265/2572] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:15.299176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af041f8d-d197-45fe-b2a3-5ad0363464df admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:15.365116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af041f8d-d197-45fe-b2a3-5ad0363464df admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.369829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1ddc7-fea8-4562-b260-2e02300da427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.370519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1ddc7-fea8-4562-b260-2e02300da427 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.370824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1ddc7-fea8-4562-b260-2e02300da427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.371081 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1ddc7-fea8-4562-b260-2e02300da427 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.371763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1ddc7-fea8-4562-b260-2e02300da427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.373645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1ddc7-fea8-4562-b260-2e02300da427 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.399783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1308/2573] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:15 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:15.405763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115652b-46a0-404d-a815-8b5f626da3eb None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:15.417979 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115652b-46a0-404d-a815-8b5f626da3eb None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.483266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e670a-0410-4add-b291-b8e2613f2504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.483878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e670a-0410-4add-b291-b8e2613f2504 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.484158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e670a-0410-4add-b291-b8e2613f2504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.484431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e670a-0410-4add-b291-b8e2613f2504 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.485149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e670a-0410-4add-b291-b8e2613f2504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.487372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e670a-0410-4add-b291-b8e2613f2504 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.529308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1266/2574] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:15 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:15.531694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1ddc7-fea8-4562-b260-2e02300da427 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:15.542362 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1ddc7-fea8-4562-b260-2e02300da427 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.547437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6ea0-43ec-4fa4-87b8-1206ef2dbea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.548182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6ea0-43ec-4fa4-87b8-1206ef2dbea8 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.548502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6ea0-43ec-4fa4-87b8-1206ef2dbea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.548952 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6ea0-43ec-4fa4-87b8-1206ef2dbea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.549687 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a6ea0-43ec-4fa4-87b8-1206ef2dbea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.551359 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a6ea0-43ec-4fa4-87b8-1206ef2dbea8 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.563060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1309/2575] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:15.567439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e670a-0410-4add-b291-b8e2613f2504 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:15.578792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e670a-0410-4add-b291-b8e2613f2504 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.587176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ecd41-7b8e-4ea3-9079-31289c4e76e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.588605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ecd41-7b8e-4ea3-9079-31289c4e76e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.588890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ecd41-7b8e-4ea3-9079-31289c4e76e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.589165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ecd41-7b8e-4ea3-9079-31289c4e76e1 admin admin] PATH_INFO: `/v3/projects/df825d942d3b455abaa3c03e15fa534e/users/46aabc635e7640d3a930cb8c39c7cef5/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.605596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ecd41-7b8e-4ea3-9079-31289c4e76e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df825d942d3b455abaa3c03e15fa534e, user_id=46aabc635e7640d3a930cb8c39c7cef5, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.608421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ecd41-7b8e-4ea3-9079-31289c4e76e1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.622938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1267/2576] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:15 2022] PUT /identity/v3/projects/df825d942d3b455abaa3c03e15fa534e/users/46aabc635e7640d3a930cb8c39c7cef5/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:15.627770 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6ea0-43ec-4fa4-87b8-1206ef2dbea8 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:15.641646 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6ea0-43ec-4fa4-87b8-1206ef2dbea8 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.710881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c99570-c165-4201-83bd-fc1feb7a057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.711563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99570-c165-4201-83bd-fc1feb7a057f admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.711844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99570-c165-4201-83bd-fc1feb7a057f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.712119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99570-c165-4201-83bd-fc1feb7a057f admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.712912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c99570-c165-4201-83bd-fc1feb7a057f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.714590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c99570-c165-4201-83bd-fc1feb7a057f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.725815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1310/2577] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:15.730647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ecd41-7b8e-4ea3-9079-31289c4e76e1 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:15.743758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ecd41-7b8e-4ea3-9079-31289c4e76e1 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.751724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342144b1-0329-4ba2-809e-444fd4bcefa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.752635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342144b1-0329-4ba2-809e-444fd4bcefa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.752922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342144b1-0329-4ba2-809e-444fd4bcefa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.753196 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342144b1-0329-4ba2-809e-444fd4bcefa3 admin admin] PATH_INFO: `/v3/projects/df825d942d3b455abaa3c03e15fa534e/users/46aabc635e7640d3a930cb8c39c7cef5/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.755238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342144b1-0329-4ba2-809e-444fd4bcefa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df825d942d3b455abaa3c03e15fa534e, user_id=46aabc635e7640d3a930cb8c39c7cef5, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.757976 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342144b1-0329-4ba2-809e-444fd4bcefa3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.769191 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1268/2578] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:15 2022] PUT /identity/v3/projects/df825d942d3b455abaa3c03e15fa534e/users/46aabc635e7640d3a930cb8c39c7cef5/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:15.780750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6b5d4-c9f2-4989-a36f-0acf59e32c40 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.781187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6b5d4-c9f2-4989-a36f-0acf59e32c40 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.781501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6b5d4-c9f2-4989-a36f-0acf59e32c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.811535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:15.815070 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-88b6b5d4-c9f2-4989-a36f-0acf59e32c40 None None] MFA Rules not processed for user `46aabc635e7640d3a930cb8c39c7cef5`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:15.816796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-88b6b5d4-c9f2-4989-a36f-0acf59e32c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:15.892254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1311/2579] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:15.903626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342144b1-0329-4ba2-809e-444fd4bcefa3 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:15.905431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-342144b1-0329-4ba2-809e-444fd4bcefa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:15.967957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342144b1-0329-4ba2-809e-444fd4bcefa3 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:15.971791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ad37d-53c8-44a4-929a-b64b6442661b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:15.972456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ad37d-53c8-44a4-929a-b64b6442661b service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:15.972743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ad37d-53c8-44a4-929a-b64b6442661b service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:15.973021 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ad37d-53c8-44a4-929a-b64b6442661b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:15.983327 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ad37d-53c8-44a4-929a-b64b6442661b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:15.984779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ad37d-53c8-44a4-929a-b64b6442661b service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:15.994636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1269/2580] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:16.421228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6b5d4-c9f2-4989-a36f-0acf59e32c40 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:16.485729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6b5d4-c9f2-4989-a36f-0acf59e32c40 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:16.499118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:16.499118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:16.499118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:16.499118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] PATH_INFO: `/v3/users/f20cf592df6540d28f88cbd61f12cf07` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:16.499631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20cf592df6540d28f88cbd61f12cf07)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:16.499631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:16.564645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20cf592df6540d28f88cbd61f12cf07'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:16.583702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20cf592df6540d28f88cbd61f12cf07'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:16.584569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20cf592df6540d28f88cbd61f12cf07'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:16.591972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20cf592df6540d28f88cbd61f12cf07'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:16.599869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20cf592df6540d28f88cbd61f12cf07'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:16.606761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1312/2581] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:16 2022] DELETE /identity/v3/users/f20cf592df6540d28f88cbd61f12cf07 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:16.611440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e6b22-0d3c-45fa-b92b-bf67f9d01519 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:16.611967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e6b22-0d3c-45fa-b92b-bf67f9d01519 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:16.612068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e6b22-0d3c-45fa-b92b-bf67f9d01519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:16.631544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-776e6b22-0d3c-45fa-b92b-bf67f9d01519 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:16.632787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-776e6b22-0d3c-45fa-b92b-bf67f9d01519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:16.675510 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:16.701231 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1270/2582] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:16.710732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:16.712194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:16.734824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:16.789312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6718b1-994c-4ed9-acb4-072f53737018 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:16.793251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b28ee-1812-4bd5-956f-2049deb5bb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:16.793989 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b28ee-1812-4bd5-956f-2049deb5bb35 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:16.794106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b28ee-1812-4bd5-956f-2049deb5bb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:16.794400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b28ee-1812-4bd5-956f-2049deb5bb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:16.804303 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b28ee-1812-4bd5-956f-2049deb5bb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:16.805751 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b28ee-1812-4bd5-956f-2049deb5bb35 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:16.816987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1313/2583] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:17.114792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e6b22-0d3c-45fa-b92b-bf67f9d01519 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:17.116574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-776e6b22-0d3c-45fa-b92b-bf67f9d01519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:17.130113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e6b22-0d3c-45fa-b92b-bf67f9d01519 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:17.135839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:17.137011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:17.137161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:17.137366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] PATH_INFO: `/v3/projects/cd12482f019c4cfc832693c0f11c2fcf` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:17.139229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd12482f019c4cfc832693c0f11c2fcf)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:17.140600 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:17.194771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd12482f019c4cfc832693c0f11c2fcf', 'request_id': 'req-0fd3254f-0c09-41c1-9f00-2038b74daa5a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.203165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd12482f019c4cfc832693c0f11c2fcf', 'request_id': 'req-0fd3254f-0c09-41c1-9f00-2038b74daa5a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.210027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd12482f019c4cfc832693c0f11c2fcf', 'request_id': 'req-0fd3254f-0c09-41c1-9f00-2038b74daa5a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.221644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] The token cache is being invalidate because project cd12482f019c4cfc832693c0f11c2fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:17.221938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.226430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.226430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1271/2584] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:17 2022] DELETE /identity/v3/projects/cd12482f019c4cfc832693c0f11c2fcf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:17.230473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b28ee-1812-4bd5-956f-2049deb5bb35 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:17.241998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b28ee-1812-4bd5-956f-2049deb5bb35 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:17.306005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:17.306902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:17.307190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:17.307472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] PATH_INFO: `/v3/users/46aabc635e7640d3a930cb8c39c7cef5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:17.308778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46aabc635e7640d3a930cb8c39c7cef5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:17.310893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:17.360053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46aabc635e7640d3a930cb8c39c7cef5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.380906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46aabc635e7640d3a930cb8c39c7cef5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.381817 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46aabc635e7640d3a930cb8c39c7cef5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.390192 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46aabc635e7640d3a930cb8c39c7cef5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.398755 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-ce1eae02-74da-4648-9485-512ed503b8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46aabc635e7640d3a930cb8c39c7cef5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.407745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1314/2585] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:17 2022] DELETE /identity/v3/users/46aabc635e7640d3a930cb8c39c7cef5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:17.736488 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:17.738194 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:17.754854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3254f-0c09-41c1-9f00-2038b74daa5a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:17.833167 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:17.833974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:17.834258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:17.834579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] PATH_INFO: `/v3/projects/df825d942d3b455abaa3c03e15fa534e` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:17.835776 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df825d942d3b455abaa3c03e15fa534e)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:17.837722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:17.886666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df825d942d3b455abaa3c03e15fa534e', 'request_id': 'req-50735c5e-940e-49f6-87d8-454256b842e8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.899786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df825d942d3b455abaa3c03e15fa534e', 'request_id': 'req-50735c5e-940e-49f6-87d8-454256b842e8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.911725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df825d942d3b455abaa3c03e15fa534e', 'request_id': 'req-50735c5e-940e-49f6-87d8-454256b842e8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.919144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:17.925514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] The token cache is being invalidate because project df825d942d3b455abaa3c03e15fa534e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:17.925841 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.926722 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-50735c5e-940e-49f6-87d8-454256b842e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:17.934598 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1272/2586] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:17 2022] DELETE /identity/v3/projects/df825d942d3b455abaa3c03e15fa534e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:17.936025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1fb91-ad47-418c-af9a-dce9c5ea0687 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:17.936725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1fb91-ad47-418c-af9a-dce9c5ea0687 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:17.936725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1fb91-ad47-418c-af9a-dce9c5ea0687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:17.956861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-bbc1fb91-ad47-418c-af9a-dce9c5ea0687 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:17.958078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bbc1fb91-ad47-418c-af9a-dce9c5ea0687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:17.994262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:18.026445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1315/2587] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:18.034186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681deb25-23a1-439a-a4c2-8c259bd1de2e None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.034527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681deb25-23a1-439a-a4c2-8c259bd1de2e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.034792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681deb25-23a1-439a-a4c2-8c259bd1de2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.054070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-681deb25-23a1-439a-a4c2-8c259bd1de2e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:18.055295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-681deb25-23a1-439a-a4c2-8c259bd1de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:18.063928 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1273/2588] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:18.068478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1fb91-ad47-418c-af9a-dce9c5ea0687 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.079470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1fb91-ad47-418c-af9a-dce9c5ea0687 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.085446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2f38d-841f-4c78-a049-a2606d2d7f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.086309 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f38d-841f-4c78-a049-a2606d2d7f51 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.086666 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f38d-841f-4c78-a049-a2606d2d7f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.087213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f38d-841f-4c78-a049-a2606d2d7f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.088616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2f38d-841f-4c78-a049-a2606d2d7f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:18.088933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2f38d-841f-4c78-a049-a2606d2d7f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.090586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2f38d-841f-4c78-a049-a2606d2d7f51 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.103398 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1316/2589] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:18.107774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681deb25-23a1-439a-a4c2-8c259bd1de2e None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.117054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681deb25-23a1-439a-a4c2-8c259bd1de2e None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.122649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a448-c736-43ab-bad9-f41647c4e10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.123299 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a448-c736-43ab-bad9-f41647c4e10e admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.123582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a448-c736-43ab-bad9-f41647c4e10e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.123858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557a448-c736-43ab-bad9-f41647c4e10e admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.124550 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a448-c736-43ab-bad9-f41647c4e10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.126474 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557a448-c736-43ab-bad9-f41647c4e10e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.154443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1274/2590] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:18 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:18.158588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2f38d-841f-4c78-a049-a2606d2d7f51 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.169008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2f38d-841f-4c78-a049-a2606d2d7f51 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.231349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9283a92-0b93-40d4-809e-53a36a0d57c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.232024 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9283a92-0b93-40d4-809e-53a36a0d57c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.232312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9283a92-0b93-40d4-809e-53a36a0d57c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.232593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9283a92-0b93-40d4-809e-53a36a0d57c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.233296 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9283a92-0b93-40d4-809e-53a36a0d57c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.235326 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9283a92-0b93-40d4-809e-53a36a0d57c0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.257582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1317/2591] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:18 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:18.262255 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a448-c736-43ab-bad9-f41647c4e10e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.272520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557a448-c736-43ab-bad9-f41647c4e10e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.277143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8c8b2-1a99-4388-8d2e-b4a28e44794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.277797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8c8b2-1a99-4388-8d2e-b4a28e44794a admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.278076 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8c8b2-1a99-4388-8d2e-b4a28e44794a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.278347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8c8b2-1a99-4388-8d2e-b4a28e44794a admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.279095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8c8b2-1a99-4388-8d2e-b4a28e44794a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.280706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8c8b2-1a99-4388-8d2e-b4a28e44794a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.293064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1275/2592] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:18.298234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9283a92-0b93-40d4-809e-53a36a0d57c0 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.308886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9283a92-0b93-40d4-809e-53a36a0d57c0 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.313644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f4868-11d0-4b9c-938e-092c9e3e3fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.314319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f4868-11d0-4b9c-938e-092c9e3e3fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.314645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f4868-11d0-4b9c-938e-092c9e3e3fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.314934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f4868-11d0-4b9c-938e-092c9e3e3fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.315814 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f4868-11d0-4b9c-938e-092c9e3e3fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.317409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f4868-11d0-4b9c-938e-092c9e3e3fb2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.330014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1318/2593] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:18.334469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8c8b2-1a99-4388-8d2e-b4a28e44794a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.346967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8c8b2-1a99-4388-8d2e-b4a28e44794a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.353180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023fa4-9b90-41fd-9283-a86198b8d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.354177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023fa4-9b90-41fd-9283-a86198b8d1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.354595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023fa4-9b90-41fd-9283-a86198b8d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.354908 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023fa4-9b90-41fd-9283-a86198b8d1d1 admin admin] PATH_INFO: `/v3/projects/75a73d1be26e42c2b0bf3ef69127f813/users/beefbb68abb9405fa05cb45a2c8f9233/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.371221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023fa4-9b90-41fd-9283-a86198b8d1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a73d1be26e42c2b0bf3ef69127f813, user_id=beefbb68abb9405fa05cb45a2c8f9233, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.373991 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023fa4-9b90-41fd-9283-a86198b8d1d1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.392462 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1276/2594] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:18 2022] PUT /identity/v3/projects/75a73d1be26e42c2b0bf3ef69127f813/users/beefbb68abb9405fa05cb45a2c8f9233/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:18.404639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c789bca-2836-4aab-b962-ba5d79710e59 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.404939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c789bca-2836-4aab-b962-ba5d79710e59 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.405211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c789bca-2836-4aab-b962-ba5d79710e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.445620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1c789bca-2836-4aab-b962-ba5d79710e59 None None] MFA Rules not processed for user `beefbb68abb9405fa05cb45a2c8f9233`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:18.447013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1c789bca-2836-4aab-b962-ba5d79710e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:18.521992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1319/2595] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:18.527091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023fa4-9b90-41fd-9283-a86198b8d1d1 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.621358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023fa4-9b90-41fd-9283-a86198b8d1d1 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.627117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4efec5-db91-4dc3-b17d-4345026133c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.627842 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4efec5-db91-4dc3-b17d-4345026133c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.628129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4efec5-db91-4dc3-b17d-4345026133c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.628405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4efec5-db91-4dc3-b17d-4345026133c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.629305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4efec5-db91-4dc3-b17d-4345026133c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.631233 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4efec5-db91-4dc3-b17d-4345026133c2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.670613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1277/2596] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:18 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:18.675607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c789bca-2836-4aab-b962-ba5d79710e59 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.699143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c789bca-2836-4aab-b962-ba5d79710e59 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.769053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:18.804603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875d7d-7724-41bf-976b-10fa9aa1b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.805824 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875d7d-7724-41bf-976b-10fa9aa1b55d admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.806241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875d7d-7724-41bf-976b-10fa9aa1b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.807206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875d7d-7724-41bf-976b-10fa9aa1b55d admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.807916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875d7d-7724-41bf-976b-10fa9aa1b55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.810048 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875d7d-7724-41bf-976b-10fa9aa1b55d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.834809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1320/2597] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:18 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:18.839000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4efec5-db91-4dc3-b17d-4345026133c2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.850730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4efec5-db91-4dc3-b17d-4345026133c2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.856356 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf85644-25d2-4c0f-b7e2-6a34ab96e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.857036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf85644-25d2-4c0f-b7e2-6a34ab96e1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.857323 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf85644-25d2-4c0f-b7e2-6a34ab96e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.857603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf85644-25d2-4c0f-b7e2-6a34ab96e1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.858608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf85644-25d2-4c0f-b7e2-6a34ab96e1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.860066 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf85644-25d2-4c0f-b7e2-6a34ab96e1c0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.872151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1278/2598] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:18.876279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875d7d-7724-41bf-976b-10fa9aa1b55d admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.888652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875d7d-7724-41bf-976b-10fa9aa1b55d admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:18.898837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25003a-4c11-40cd-ac76-f0f15d9517f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:18.899865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25003a-4c11-40cd-ac76-f0f15d9517f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:18.900155 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25003a-4c11-40cd-ac76-f0f15d9517f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:18.900515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25003a-4c11-40cd-ac76-f0f15d9517f0 admin admin] PATH_INFO: `/v3/projects/c6649aa4354943668182176db02d2f6c/users/f38715f40f124394a8a727f4e3adcdd2/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:18.923782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25003a-4c11-40cd-ac76-f0f15d9517f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6649aa4354943668182176db02d2f6c, user_id=f38715f40f124394a8a727f4e3adcdd2, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:18.926939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25003a-4c11-40cd-ac76-f0f15d9517f0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:18.943472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1321/2599] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:18 2022] PUT /identity/v3/projects/c6649aa4354943668182176db02d2f6c/users/f38715f40f124394a8a727f4e3adcdd2/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:18.948309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf85644-25d2-4c0f-b7e2-6a34ab96e1c0 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:18.965345 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf85644-25d2-4c0f-b7e2-6a34ab96e1c0 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:19.054358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a92df-2bf3-4fa5-b2d8-e7fabdf41a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:19.055189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a92df-2bf3-4fa5-b2d8-e7fabdf41a26 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:19.055815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a92df-2bf3-4fa5-b2d8-e7fabdf41a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:19.055815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a92df-2bf3-4fa5-b2d8-e7fabdf41a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:19.056739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a92df-2bf3-4fa5-b2d8-e7fabdf41a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:19.058433 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a92df-2bf3-4fa5-b2d8-e7fabdf41a26 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:19.074349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1279/2600] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:19.075628 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25003a-4c11-40cd-ac76-f0f15d9517f0 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:19.096783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25003a-4c11-40cd-ac76-f0f15d9517f0 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:19.104581 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11ebfa-f6ea-40f0-bf98-09d15b49f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:19.105497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11ebfa-f6ea-40f0-bf98-09d15b49f527 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:19.105788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11ebfa-f6ea-40f0-bf98-09d15b49f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:19.106067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11ebfa-f6ea-40f0-bf98-09d15b49f527 admin admin] PATH_INFO: `/v3/projects/c6649aa4354943668182176db02d2f6c/users/f38715f40f124394a8a727f4e3adcdd2/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:19.108206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11ebfa-f6ea-40f0-bf98-09d15b49f527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6649aa4354943668182176db02d2f6c, user_id=f38715f40f124394a8a727f4e3adcdd2, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:19.110865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11ebfa-f6ea-40f0-bf98-09d15b49f527 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:19.121958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1322/2601] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:19 2022] PUT /identity/v3/projects/c6649aa4354943668182176db02d2f6c/users/f38715f40f124394a8a727f4e3adcdd2/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:19.132419 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647edbf0-82c3-4966-aed9-b36d5b473a23 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:19.132634 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647edbf0-82c3-4966-aed9-b36d5b473a23 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:19.132916 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647edbf0-82c3-4966-aed9-b36d5b473a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:19.139772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:19.167514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-647edbf0-82c3-4966-aed9-b36d5b473a23 None None] MFA Rules not processed for user `f38715f40f124394a8a727f4e3adcdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:19.169760 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-647edbf0-82c3-4966-aed9-b36d5b473a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:19.249704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1280/2602] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:19.260650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11ebfa-f6ea-40f0-bf98-09d15b49f527 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:19.262442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ee11ebfa-f6ea-40f0-bf98-09d15b49f527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:19.326295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11ebfa-f6ea-40f0-bf98-09d15b49f527 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:19.330023 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e434-663f-4d54-ba51-c02c87873962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:19.330708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e434-663f-4d54-ba51-c02c87873962 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:19.330995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e434-663f-4d54-ba51-c02c87873962 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:19.331275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8e434-663f-4d54-ba51-c02c87873962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:19.341619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8e434-663f-4d54-ba51-c02c87873962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:19.343247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8e434-663f-4d54-ba51-c02c87873962 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:19.356621 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1323/2603] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:20.808225 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d287c6-8c9c-4c17-84e6-a6aaf74aae22 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:20.808900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d287c6-8c9c-4c17-84e6-a6aaf74aae22 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:20.808900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d287c6-8c9c-4c17-84e6-a6aaf74aae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:20.839620 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-36d287c6-8c9c-4c17-84e6-a6aaf74aae22 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:20.841288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-36d287c6-8c9c-4c17-84e6-a6aaf74aae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:20.925172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1281/2604] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jun 16 18:56:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:20.942784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e434-663f-4d54-ba51-c02c87873962 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:20.944882 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3ea8e434-663f-4d54-ba51-c02c87873962 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:20.959505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d287c6-8c9c-4c17-84e6-a6aaf74aae22 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:21.046861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8e434-663f-4d54-ba51-c02c87873962 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:21.051632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d287c6-8c9c-4c17-84e6-a6aaf74aae22 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:21.052929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1787-c941-4d4f-9780-4691c63e7a05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:21.053728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1787-c941-4d4f-9780-4691c63e7a05 service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:21.054019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1787-c941-4d4f-9780-4691c63e7a05 service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:21.054635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1787-c941-4d4f-9780-4691c63e7a05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:21.057740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:21.058932 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:21.059244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:21.059573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] PATH_INFO: `/v3/users/beefbb68abb9405fa05cb45a2c8f9233` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:21.060987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beefbb68abb9405fa05cb45a2c8f9233)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:21.063229 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:21.069914 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c1787-c941-4d4f-9780-4691c63e7a05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:21.071586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c1787-c941-4d4f-9780-4691c63e7a05 service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:21.080942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1324/2605] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:56:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:56:21.121645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:21.136455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beefbb68abb9405fa05cb45a2c8f9233'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.159364 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beefbb68abb9405fa05cb45a2c8f9233'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.168887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beefbb68abb9405fa05cb45a2c8f9233'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.191156 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beefbb68abb9405fa05cb45a2c8f9233'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.202014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beefbb68abb9405fa05cb45a2c8f9233'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.209747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1282/2606] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:20 2022] DELETE /identity/v3/users/beefbb68abb9405fa05cb45a2c8f9233 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:21.216457 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159626-4a18-4de7-8a4e-77385287974a None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:21.216781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159626-4a18-4de7-8a4e-77385287974a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:21.217060 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159626-4a18-4de7-8a4e-77385287974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:21.240916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-55159626-4a18-4de7-8a4e-77385287974a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:21.242210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-55159626-4a18-4de7-8a4e-77385287974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:21.273980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:21.352997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1325/2607] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:21.363240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:21.364737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:21.440951 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e898c9-d2ba-4ae4-ab3a-2bb762359865 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:21.445764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a2dd1-7c11-419d-b0a4-0fce75981979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:21.446540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2dd1-7c11-419d-b0a4-0fce75981979 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:21.447393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2dd1-7c11-419d-b0a4-0fce75981979 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:21.447668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a2dd1-7c11-419d-b0a4-0fce75981979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:21.458070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a2dd1-7c11-419d-b0a4-0fce75981979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:21.459613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a2dd1-7c11-419d-b0a4-0fce75981979 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:21.471910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1283/2608] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:21.773583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159626-4a18-4de7-8a4e-77385287974a None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:21.776470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-55159626-4a18-4de7-8a4e-77385287974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:21.796828 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159626-4a18-4de7-8a4e-77385287974a None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:21.801592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:21.802496 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:21.802777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:21.803055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] PATH_INFO: `/v3/projects/75a73d1be26e42c2b0bf3ef69127f813` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:21.804230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a73d1be26e42c2b0bf3ef69127f813)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:21.806252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:21.858772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a73d1be26e42c2b0bf3ef69127f813', 'request_id': 'req-bb71daac-c425-4c8a-8536-39e5b9aa1e20'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.864985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a73d1be26e42c2b0bf3ef69127f813', 'request_id': 'req-bb71daac-c425-4c8a-8536-39e5b9aa1e20'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.872505 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a73d1be26e42c2b0bf3ef69127f813', 'request_id': 'req-bb71daac-c425-4c8a-8536-39e5b9aa1e20'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.883572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] The token cache is being invalidate because project 75a73d1be26e42c2b0bf3ef69127f813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:21.883875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.885025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:21.886664 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1326/2609] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:21 2022] DELETE /identity/v3/projects/75a73d1be26e42c2b0bf3ef69127f813 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:21.890742 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a2dd1-7c11-419d-b0a4-0fce75981979 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:21.904056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a2dd1-7c11-419d-b0a4-0fce75981979 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:21.967348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:21.969017 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:21.969758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:21.970305 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] PATH_INFO: `/v3/users/f38715f40f124394a8a727f4e3adcdd2` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:21.972062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38715f40f124394a8a727f4e3adcdd2)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:21.974395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:22.026887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38715f40f124394a8a727f4e3adcdd2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.045972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:22.053654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38715f40f124394a8a727f4e3adcdd2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.055239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38715f40f124394a8a727f4e3adcdd2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.065727 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38715f40f124394a8a727f4e3adcdd2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.075664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-79d30237-c76a-4f3b-8254-18dd380425f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38715f40f124394a8a727f4e3adcdd2'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.083265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1284/2610] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:21 2022] DELETE /identity/v3/users/f38715f40f124394a8a727f4e3adcdd2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:56:22.404851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:22.406526 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:22.422926 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71daac-c425-4c8a-8536-39e5b9aa1e20 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:22.489292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:22.490123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:22.490440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:22.490723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] PATH_INFO: `/v3/projects/c6649aa4354943668182176db02d2f6c` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:22.492091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6649aa4354943668182176db02d2f6c)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:22.494495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:22.546460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:22.551623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6649aa4354943668182176db02d2f6c', 'request_id': 'req-85860604-7cb2-478a-83cc-0bccbc1de8e6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.560851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6649aa4354943668182176db02d2f6c', 'request_id': 'req-85860604-7cb2-478a-83cc-0bccbc1de8e6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.569105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6649aa4354943668182176db02d2f6c', 'request_id': 'req-85860604-7cb2-478a-83cc-0bccbc1de8e6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.579922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] The token cache is being invalidate because project c6649aa4354943668182176db02d2f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:22.580206 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.580823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-85860604-7cb2-478a-83cc-0bccbc1de8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:22.582347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1327/2611] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:22 2022] DELETE /identity/v3/projects/c6649aa4354943668182176db02d2f6c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:22.587334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cdb43-4715-4d3f-9104-d7a38894e381 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:22.587626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cdb43-4715-4d3f-9104-d7a38894e381 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:22.587908 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cdb43-4715-4d3f-9104-d7a38894e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:22.608383 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-9e0cdb43-4715-4d3f-9104-d7a38894e381 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:22.609589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-9e0cdb43-4715-4d3f-9104-d7a38894e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:22.677508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1285/2612] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:22.685777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35e9bd-a9d9-4c2d-97a8-be42f27bbbbc None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:22.686342 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35e9bd-a9d9-4c2d-97a8-be42f27bbbbc None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:22.686761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35e9bd-a9d9-4c2d-97a8-be42f27bbbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:22.707990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-eb35e9bd-a9d9-4c2d-97a8-be42f27bbbbc None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:22.709317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-eb35e9bd-a9d9-4c2d-97a8-be42f27bbbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:22.718561 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1328/2613] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:22.722910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cdb43-4715-4d3f-9104-d7a38894e381 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:22.735745 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cdb43-4715-4d3f-9104-d7a38894e381 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:22.741180 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815859dd-8f0c-4d30-8d8a-782ce2a4cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:22.741822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815859dd-8f0c-4d30-8d8a-782ce2a4cc23 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:22.742105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815859dd-8f0c-4d30-8d8a-782ce2a4cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:22.742414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815859dd-8f0c-4d30-8d8a-782ce2a4cc23 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:22.743177 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815859dd-8f0c-4d30-8d8a-782ce2a4cc23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:22.744045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815859dd-8f0c-4d30-8d8a-782ce2a4cc23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:22.746197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815859dd-8f0c-4d30-8d8a-782ce2a4cc23 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:22.759458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1286/2614] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 18:56:22.763722 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35e9bd-a9d9-4c2d-97a8-be42f27bbbbc None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:22.773483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35e9bd-a9d9-4c2d-97a8-be42f27bbbbc None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:22.778958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c839fb-ae48-4f38-8806-1bf4ae313e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:22.779616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c839fb-ae48-4f38-8806-1bf4ae313e43 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:22.780004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c839fb-ae48-4f38-8806-1bf4ae313e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:22.780288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c839fb-ae48-4f38-8806-1bf4ae313e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:22.780980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c839fb-ae48-4f38-8806-1bf4ae313e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:22.782925 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c839fb-ae48-4f38-8806-1bf4ae313e43 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:22.833400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1329/2615] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:22 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:22.836587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815859dd-8f0c-4d30-8d8a-782ce2a4cc23 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:22.845863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815859dd-8f0c-4d30-8d8a-782ce2a4cc23 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:22.910020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def038c-d252-4938-8421-becf1bf332f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:22.911206 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def038c-d252-4938-8421-becf1bf332f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:22.911619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def038c-d252-4938-8421-becf1bf332f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:22.911902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def038c-d252-4938-8421-becf1bf332f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:22.912709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def038c-d252-4938-8421-becf1bf332f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:22.915548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def038c-d252-4938-8421-becf1bf332f2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:22.951360 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1287/2616] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:22 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:22.952577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c839fb-ae48-4f38-8806-1bf4ae313e43 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:22.965404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c839fb-ae48-4f38-8806-1bf4ae313e43 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:22.972728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2418c-1f30-4c45-9601-5da85f534ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:22.973400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2418c-1f30-4c45-9601-5da85f534ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:22.974625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2418c-1f30-4c45-9601-5da85f534ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:22.975034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2418c-1f30-4c45-9601-5da85f534ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:22.976639 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2418c-1f30-4c45-9601-5da85f534ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:22.980186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2418c-1f30-4c45-9601-5da85f534ea0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:22.997396 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1330/2617] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:56:23.001165 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def038c-d252-4938-8421-becf1bf332f2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:23.012101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def038c-d252-4938-8421-becf1bf332f2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:23.017270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e602b-6052-40bc-bfc0-b3be925fbe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:23.017970 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e602b-6052-40bc-bfc0-b3be925fbe66 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.018902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e602b-6052-40bc-bfc0-b3be925fbe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.018902 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e602b-6052-40bc-bfc0-b3be925fbe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.019280 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e602b-6052-40bc-bfc0-b3be925fbe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:23.021057 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e602b-6052-40bc-bfc0-b3be925fbe66 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:23.032611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1288/2618] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:23.037161 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2418c-1f30-4c45-9601-5da85f534ea0 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:23.050274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2418c-1f30-4c45-9601-5da85f534ea0 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:23.055616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb75f17-e816-4efa-98ed-f0e8ab1eb68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:23.057121 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb75f17-e816-4efa-98ed-f0e8ab1eb68a admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.057406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb75f17-e816-4efa-98ed-f0e8ab1eb68a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.057682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb75f17-e816-4efa-98ed-f0e8ab1eb68a admin admin] PATH_INFO: `/v3/projects/6e417291570849bfb8d2da2a4e0ebd9d/users/b1cffe99b5f04837a413185f4a0f7ba0/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.073258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb75f17-e816-4efa-98ed-f0e8ab1eb68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e417291570849bfb8d2da2a4e0ebd9d, user_id=b1cffe99b5f04837a413185f4a0f7ba0, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:23.076689 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb75f17-e816-4efa-98ed-f0e8ab1eb68a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:23.090422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1331/2619] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:23 2022] PUT /identity/v3/projects/6e417291570849bfb8d2da2a4e0ebd9d/users/b1cffe99b5f04837a413185f4a0f7ba0/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:23.101879 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0532ad5-94ac-41e0-8200-73dc8ca2054c None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.102172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0532ad5-94ac-41e0-8200-73dc8ca2054c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.102481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0532ad5-94ac-41e0-8200-73dc8ca2054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.135995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d0532ad5-94ac-41e0-8200-73dc8ca2054c None None] MFA Rules not processed for user `b1cffe99b5f04837a413185f4a0f7ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:23.135995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d0532ad5-94ac-41e0-8200-73dc8ca2054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:23.170016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:23.213006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1289/2620] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:23.219501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb75f17-e816-4efa-98ed-f0e8ab1eb68a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:23.296951 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb75f17-e816-4efa-98ed-f0e8ab1eb68a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:23.301986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cbd77-7312-471a-83b5-f105fd879640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:23.302693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cbd77-7312-471a-83b5-f105fd879640 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.302982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cbd77-7312-471a-83b5-f105fd879640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.303258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cbd77-7312-471a-83b5-f105fd879640 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.303950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cbd77-7312-471a-83b5-f105fd879640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:23.306467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cbd77-7312-471a-83b5-f105fd879640 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:23.332485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1332/2621] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:23 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:56:23.336564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0532ad5-94ac-41e0-8200-73dc8ca2054c None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:23.347769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0532ad5-94ac-41e0-8200-73dc8ca2054c None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:23.412217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0efae-e2af-49e3-8530-0612753c6a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:23.413110 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0efae-e2af-49e3-8530-0612753c6a17 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.413528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0efae-e2af-49e3-8530-0612753c6a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.413862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0efae-e2af-49e3-8530-0612753c6a17 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.415903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0efae-e2af-49e3-8530-0612753c6a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:23.419318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0efae-e2af-49e3-8530-0612753c6a17 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:23.442646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1290/2622] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:23 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:23.446757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cbd77-7312-471a-83b5-f105fd879640 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:23.457850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cbd77-7312-471a-83b5-f105fd879640 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:23.465029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb129f-1d34-4a80-a902-ab900272e186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:23.465706 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb129f-1d34-4a80-a902-ab900272e186 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.465987 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb129f-1d34-4a80-a902-ab900272e186 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.466305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb129f-1d34-4a80-a902-ab900272e186 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.467126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb129f-1d34-4a80-a902-ab900272e186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:23.469312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb129f-1d34-4a80-a902-ab900272e186 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:23.484456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1333/2623] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:23.488799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0efae-e2af-49e3-8530-0612753c6a17 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:23.500663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0efae-e2af-49e3-8530-0612753c6a17 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:23.509372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde7dd-893e-4417-9fab-a8d07d3f2c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:23.510274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde7dd-893e-4417-9fab-a8d07d3f2c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.510593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde7dd-893e-4417-9fab-a8d07d3f2c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.510871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde7dd-893e-4417-9fab-a8d07d3f2c6f admin admin] PATH_INFO: `/v3/projects/16bb3063442a41f9b2223f10bf9fbc46/users/23b238a1ca9049b6afd82d6ce99de47d/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.528947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde7dd-893e-4417-9fab-a8d07d3f2c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bb3063442a41f9b2223f10bf9fbc46, user_id=23b238a1ca9049b6afd82d6ce99de47d, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:23.531383 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde7dd-893e-4417-9fab-a8d07d3f2c6f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:23.548980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1291/2624] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:23 2022] PUT /identity/v3/projects/16bb3063442a41f9b2223f10bf9fbc46/users/23b238a1ca9049b6afd82d6ce99de47d/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:56:23.553104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb129f-1d34-4a80-a902-ab900272e186 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:23.569219 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb129f-1d34-4a80-a902-ab900272e186 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:23.607380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:23.642967 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8a837-5eec-443a-8462-301130ae953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:23.644996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8a837-5eec-443a-8462-301130ae953e admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.645116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8a837-5eec-443a-8462-301130ae953e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.651856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8a837-5eec-443a-8462-301130ae953e admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.652653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8a837-5eec-443a-8462-301130ae953e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:23.654286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8a837-5eec-443a-8462-301130ae953e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:23.671260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1334/2625] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:23.675440 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde7dd-893e-4417-9fab-a8d07d3f2c6f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:23.685987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde7dd-893e-4417-9fab-a8d07d3f2c6f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:23.690748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e3d11-0567-4006-a233-3bce6600e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:23.691627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e3d11-0567-4006-a233-3bce6600e60f admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.691910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e3d11-0567-4006-a233-3bce6600e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.692183 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e3d11-0567-4006-a233-3bce6600e60f admin admin] PATH_INFO: `/v3/projects/16bb3063442a41f9b2223f10bf9fbc46/users/23b238a1ca9049b6afd82d6ce99de47d/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.694289 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e3d11-0567-4006-a233-3bce6600e60f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bb3063442a41f9b2223f10bf9fbc46, user_id=23b238a1ca9049b6afd82d6ce99de47d, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:23.697007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e3d11-0567-4006-a233-3bce6600e60f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:23.707477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1292/2626] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:23 2022] PUT /identity/v3/projects/16bb3063442a41f9b2223f10bf9fbc46/users/23b238a1ca9049b6afd82d6ce99de47d/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:23.720847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1055e-906e-436b-8491-29b1797ac4ca None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.721141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1055e-906e-436b-8491-29b1797ac4ca None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.721416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1055e-906e-436b-8491-29b1797ac4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.747977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-43a1055e-906e-436b-8491-29b1797ac4ca None None] MFA Rules not processed for user `23b238a1ca9049b6afd82d6ce99de47d`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:23.749180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-43a1055e-906e-436b-8491-29b1797ac4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:23.823355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1335/2627] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:23.830963 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e3d11-0567-4006-a233-3bce6600e60f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:23.832918 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1d2e3d11-0567-4006-a233-3bce6600e60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:23.893112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e3d11-0567-4006-a233-3bce6600e60f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:23.896808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b3659-39f4-4264-b2d8-8ed25ae8689b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:23.898350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b3659-39f4-4264-b2d8-8ed25ae8689b service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:23.898350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b3659-39f4-4264-b2d8-8ed25ae8689b service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:23.898350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b3659-39f4-4264-b2d8-8ed25ae8689b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:23.907859 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b3659-39f4-4264-b2d8-8ed25ae8689b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:23.909302 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b3659-39f4-4264-b2d8-8ed25ae8689b service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:23.919155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1293/2628] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:23.985938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1055e-906e-436b-8491-29b1797ac4ca None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:24.063515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1055e-906e-436b-8491-29b1797ac4ca None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:24.068210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:24.069137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:24.069600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:24.069874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] PATH_INFO: `/v3/users/b1cffe99b5f04837a413185f4a0f7ba0` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:24.071279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cffe99b5f04837a413185f4a0f7ba0)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:24.073728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:24.120090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cffe99b5f04837a413185f4a0f7ba0'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.128439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:24.133441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cffe99b5f04837a413185f4a0f7ba0'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.134789 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cffe99b5f04837a413185f4a0f7ba0'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.142152 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cffe99b5f04837a413185f4a0f7ba0'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.150660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cffe99b5f04837a413185f4a0f7ba0'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.156881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1336/2629] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:23 2022] DELETE /identity/v3/users/b1cffe99b5f04837a413185f4a0f7ba0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:24.161864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724feac-b539-4801-ac42-761c0932a4a3 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:24.162298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724feac-b539-4801-ac42-761c0932a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:24.162698 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724feac-b539-4801-ac42-761c0932a4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:24.183629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d724feac-b539-4801-ac42-761c0932a4a3 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:24.185377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d724feac-b539-4801-ac42-761c0932a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:24.207739 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:24.251656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1294/2630] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:24.262246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:24.263679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:24.322031 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464c272-1ab9-457f-8ef7-ebb724e4148b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:24.325606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0581b6c-5cc0-4041-a04c-cb08afd76252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:24.326247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0581b6c-5cc0-4041-a04c-cb08afd76252 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:24.326568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0581b6c-5cc0-4041-a04c-cb08afd76252 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:24.326849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0581b6c-5cc0-4041-a04c-cb08afd76252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:24.336200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0581b6c-5cc0-4041-a04c-cb08afd76252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:24.338172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0581b6c-5cc0-4041-a04c-cb08afd76252 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:24.347827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1337/2631] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:24.618151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724feac-b539-4801-ac42-761c0932a4a3 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:24.619663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d724feac-b539-4801-ac42-761c0932a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:24.633771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724feac-b539-4801-ac42-761c0932a4a3 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:24.639822 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:24.641223 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:24.641570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:24.642116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] PATH_INFO: `/v3/projects/6e417291570849bfb8d2da2a4e0ebd9d` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:24.643458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e417291570849bfb8d2da2a4e0ebd9d)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:24.645436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:24.699783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e417291570849bfb8d2da2a4e0ebd9d', 'request_id': 'req-f4e94972-48e0-48a4-89f2-82f0bf87928c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.707562 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e417291570849bfb8d2da2a4e0ebd9d', 'request_id': 'req-f4e94972-48e0-48a4-89f2-82f0bf87928c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.714763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e417291570849bfb8d2da2a4e0ebd9d', 'request_id': 'req-f4e94972-48e0-48a4-89f2-82f0bf87928c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.725238 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] The token cache is being invalidate because project 6e417291570849bfb8d2da2a4e0ebd9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:24.725520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.726144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.727636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1295/2632] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:24 2022] DELETE /identity/v3/projects/6e417291570849bfb8d2da2a4e0ebd9d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:24.731633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0581b6c-5cc0-4041-a04c-cb08afd76252 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:24.741872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0581b6c-5cc0-4041-a04c-cb08afd76252 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:24.800260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:24.801286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:24.801570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:24.801839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] PATH_INFO: `/v3/users/23b238a1ca9049b6afd82d6ce99de47d` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:24.803049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b238a1ca9049b6afd82d6ce99de47d)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:24.804958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:24.850164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b238a1ca9049b6afd82d6ce99de47d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.862019 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b238a1ca9049b6afd82d6ce99de47d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.862740 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b238a1ca9049b6afd82d6ce99de47d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.869497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b238a1ca9049b6afd82d6ce99de47d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.878735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-481733ef-e9c6-4471-a28b-eeec5439f210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b238a1ca9049b6afd82d6ce99de47d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:24.880301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:24.888752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1338/2633] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:24 2022] DELETE /identity/v3/users/23b238a1ca9049b6afd82d6ce99de47d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:25.163768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:25.165263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:25.185785 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e94972-48e0-48a4-89f2-82f0bf87928c admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:25.244230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:25.245095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.245379 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.245657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] PATH_INFO: `/v3/projects/16bb3063442a41f9b2223f10bf9fbc46` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.246900 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] RBAC: Authorizing `identity:delete_project(project_id=16bb3063442a41f9b2223f10bf9fbc46)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:25.248820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:25.299939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bb3063442a41f9b2223f10bf9fbc46', 'request_id': 'req-cf80e878-0548-487b-81ce-92c7fcc1941b'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:25.302540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:25.308512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bb3063442a41f9b2223f10bf9fbc46', 'request_id': 'req-cf80e878-0548-487b-81ce-92c7fcc1941b'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:25.315197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bb3063442a41f9b2223f10bf9fbc46', 'request_id': 'req-cf80e878-0548-487b-81ce-92c7fcc1941b'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:25.326014 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] The token cache is being invalidate because project 16bb3063442a41f9b2223f10bf9fbc46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:25.326279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:25.326953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-cf80e878-0548-487b-81ce-92c7fcc1941b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:25.328495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1296/2634] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:25 2022] DELETE /identity/v3/projects/16bb3063442a41f9b2223f10bf9fbc46 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:25.333338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed736-2f39-4122-a3df-fd36e3a30b0e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.333627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed736-2f39-4122-a3df-fd36e3a30b0e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.333907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed736-2f39-4122-a3df-fd36e3a30b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.351822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ee3ed736-2f39-4122-a3df-fd36e3a30b0e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:25.353529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ee3ed736-2f39-4122-a3df-fd36e3a30b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:25.412177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1339/2635] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:25.420344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c039-f04d-43f4-8fb7-1da1e3d6d71f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.420633 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c039-f04d-43f4-8fb7-1da1e3d6d71f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.420913 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c039-f04d-43f4-8fb7-1da1e3d6d71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.440055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-c109c039-f04d-43f4-8fb7-1da1e3d6d71f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:25.441239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c109c039-f04d-43f4-8fb7-1da1e3d6d71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:25.449073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1297/2636] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:25.453197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed736-2f39-4122-a3df-fd36e3a30b0e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:25.462963 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed736-2f39-4122-a3df-fd36e3a30b0e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:25.467585 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490666-28c8-4491-b461-e498d15f34e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:25.468238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490666-28c8-4491-b461-e498d15f34e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.468522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490666-28c8-4491-b461-e498d15f34e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.468801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490666-28c8-4491-b461-e498d15f34e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.469527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490666-28c8-4491-b461-e498d15f34e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:25.469832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490666-28c8-4491-b461-e498d15f34e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:25.471467 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490666-28c8-4491-b461-e498d15f34e5 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:25.483535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1340/2637] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:25.487855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109c039-f04d-43f4-8fb7-1da1e3d6d71f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:25.497601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109c039-f04d-43f4-8fb7-1da1e3d6d71f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:25.502718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76670857-ef65-47e2-ac3a-6d2a539ceba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:25.503385 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76670857-ef65-47e2-ac3a-6d2a539ceba8 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.503660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76670857-ef65-47e2-ac3a-6d2a539ceba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.503931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76670857-ef65-47e2-ac3a-6d2a539ceba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.504650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76670857-ef65-47e2-ac3a-6d2a539ceba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:25.506712 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76670857-ef65-47e2-ac3a-6d2a539ceba8 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:25.532641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1298/2638] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:25 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:25.536939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490666-28c8-4491-b461-e498d15f34e5 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:25.548088 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490666-28c8-4491-b461-e498d15f34e5 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:25.609945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60f62a-6c02-4f55-9e48-e49d6c5a678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:25.610629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60f62a-6c02-4f55-9e48-e49d6c5a678a admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.610909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60f62a-6c02-4f55-9e48-e49d6c5a678a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.611181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60f62a-6c02-4f55-9e48-e49d6c5a678a admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.611899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60f62a-6c02-4f55-9e48-e49d6c5a678a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:25.613798 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60f62a-6c02-4f55-9e48-e49d6c5a678a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:25.634325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1341/2639] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:25 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:25.638579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76670857-ef65-47e2-ac3a-6d2a539ceba8 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:25.648764 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76670857-ef65-47e2-ac3a-6d2a539ceba8 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:25.653542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4c5c-0917-402d-b15b-41086c637e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:25.654190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4c5c-0917-402d-b15b-41086c637e94 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.654505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4c5c-0917-402d-b15b-41086c637e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.654791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4c5c-0917-402d-b15b-41086c637e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.655495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb4c5c-0917-402d-b15b-41086c637e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:25.657090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb4c5c-0917-402d-b15b-41086c637e94 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:25.668371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1299/2640] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:56:25.672391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60f62a-6c02-4f55-9e48-e49d6c5a678a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:25.682844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60f62a-6c02-4f55-9e48-e49d6c5a678a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:25.687473 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6fed3-e4bb-4eb4-8e05-2eda3f98e31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:25.688132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6fed3-e4bb-4eb4-8e05-2eda3f98e31d admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.688415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6fed3-e4bb-4eb4-8e05-2eda3f98e31d admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.688693 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6fed3-e4bb-4eb4-8e05-2eda3f98e31d admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.689412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6fed3-e4bb-4eb4-8e05-2eda3f98e31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:25.691026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6fed3-e4bb-4eb4-8e05-2eda3f98e31d admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:25.700819 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1342/2641] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:25.704828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4c5c-0917-402d-b15b-41086c637e94 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:25.715039 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4c5c-0917-402d-b15b-41086c637e94 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:25.719660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd563a76-0341-49d8-b5af-bf4b635d1329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:25.720529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd563a76-0341-49d8-b5af-bf4b635d1329 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.720813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd563a76-0341-49d8-b5af-bf4b635d1329 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.721088 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd563a76-0341-49d8-b5af-bf4b635d1329 admin admin] PATH_INFO: `/v3/projects/811799f18faa498395c7cf6dce530114/users/3682b25e4cd349939ba6c64c3b75fa2a/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.736060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd563a76-0341-49d8-b5af-bf4b635d1329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811799f18faa498395c7cf6dce530114, user_id=3682b25e4cd349939ba6c64c3b75fa2a, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:25.738727 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd563a76-0341-49d8-b5af-bf4b635d1329 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:25.751830 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1300/2642] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:25 2022] PUT /identity/v3/projects/811799f18faa498395c7cf6dce530114/users/3682b25e4cd349939ba6c64c3b75fa2a/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:25.763224 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4b52-3560-4efa-a137-4222d84b2ade None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.763715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4b52-3560-4efa-a137-4222d84b2ade None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.763813 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4b52-3560-4efa-a137-4222d84b2ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.790861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-8dbd4b52-3560-4efa-a137-4222d84b2ade None None] MFA Rules not processed for user `3682b25e4cd349939ba6c64c3b75fa2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:25.792056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8dbd4b52-3560-4efa-a137-4222d84b2ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:25.844408 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:25.855853 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1343/2643] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:25.860456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd563a76-0341-49d8-b5af-bf4b635d1329 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:25.921781 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd563a76-0341-49d8-b5af-bf4b635d1329 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:25.927439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102e829-da9b-4b89-a31a-32deab7a86a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:25.928166 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102e829-da9b-4b89-a31a-32deab7a86a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:25.928571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102e829-da9b-4b89-a31a-32deab7a86a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:25.928994 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102e829-da9b-4b89-a31a-32deab7a86a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:25.929854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102e829-da9b-4b89-a31a-32deab7a86a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:25.931908 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102e829-da9b-4b89-a31a-32deab7a86a3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:25.957034 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1301/2644] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:25 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:25.961246 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4b52-3560-4efa-a137-4222d84b2ade None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:25.972422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4b52-3560-4efa-a137-4222d84b2ade None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:26.028385 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2667e-d34f-401b-9915-9e26ec5c030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:26.029055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2667e-d34f-401b-9915-9e26ec5c030f admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:26.029340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2667e-d34f-401b-9915-9e26ec5c030f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:26.029618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2667e-d34f-401b-9915-9e26ec5c030f admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:26.030334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2667e-d34f-401b-9915-9e26ec5c030f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:26.032254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2667e-d34f-401b-9915-9e26ec5c030f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:26.053394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1344/2645] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:25 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:26.057499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102e829-da9b-4b89-a31a-32deab7a86a3 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:26.067648 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102e829-da9b-4b89-a31a-32deab7a86a3 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:26.072334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e76ea-02e0-4ed7-b6d7-87bac2db0942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:26.072975 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e76ea-02e0-4ed7-b6d7-87bac2db0942 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:26.073256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e76ea-02e0-4ed7-b6d7-87bac2db0942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:26.073530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e76ea-02e0-4ed7-b6d7-87bac2db0942 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:26.074546 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e76ea-02e0-4ed7-b6d7-87bac2db0942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:26.075855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e76ea-02e0-4ed7-b6d7-87bac2db0942 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:26.086497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1302/2646] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:26.091540 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2667e-d34f-401b-9915-9e26ec5c030f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:26.103864 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2667e-d34f-401b-9915-9e26ec5c030f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:26.108730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06885e3-6508-4dba-8a2b-01b798cdabe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:26.109471 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06885e3-6508-4dba-8a2b-01b798cdabe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:26.109812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06885e3-6508-4dba-8a2b-01b798cdabe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:26.110092 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06885e3-6508-4dba-8a2b-01b798cdabe2 admin admin] PATH_INFO: `/v3/projects/4cad1631f8314a8f96875e3f33a2fad9/users/3110b4fa482c46439aba90f75658b5cd/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:26.125943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06885e3-6508-4dba-8a2b-01b798cdabe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cad1631f8314a8f96875e3f33a2fad9, user_id=3110b4fa482c46439aba90f75658b5cd, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:26.128862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06885e3-6508-4dba-8a2b-01b798cdabe2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:26.147704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1345/2647] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:26 2022] PUT /identity/v3/projects/4cad1631f8314a8f96875e3f33a2fad9/users/3110b4fa482c46439aba90f75658b5cd/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:26.152486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e76ea-02e0-4ed7-b6d7-87bac2db0942 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:26.164178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e76ea-02e0-4ed7-b6d7-87bac2db0942 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:26.220911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:26.233626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298ff22-c9b2-43a6-86ea-d1bd64acadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:26.234471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ff22-c9b2-43a6-86ea-d1bd64acadbb admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:26.235063 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ff22-c9b2-43a6-86ea-d1bd64acadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:26.235544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ff22-c9b2-43a6-86ea-d1bd64acadbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:26.236508 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298ff22-c9b2-43a6-86ea-d1bd64acadbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:26.238122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298ff22-c9b2-43a6-86ea-d1bd64acadbb admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:26.248436 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1303/2648] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:26.254498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06885e3-6508-4dba-8a2b-01b798cdabe2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:26.268150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06885e3-6508-4dba-8a2b-01b798cdabe2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:26.273029 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f16a6-a0dc-4845-be63-2cf7e6365ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:26.273915 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f16a6-a0dc-4845-be63-2cf7e6365ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:26.274248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f16a6-a0dc-4845-be63-2cf7e6365ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:26.275139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f16a6-a0dc-4845-be63-2cf7e6365ba5 admin admin] PATH_INFO: `/v3/projects/4cad1631f8314a8f96875e3f33a2fad9/users/3110b4fa482c46439aba90f75658b5cd/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:26.277145 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f16a6-a0dc-4845-be63-2cf7e6365ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cad1631f8314a8f96875e3f33a2fad9, user_id=3110b4fa482c46439aba90f75658b5cd, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:26.279793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f16a6-a0dc-4845-be63-2cf7e6365ba5 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:26.291428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1346/2649] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:26 2022] PUT /identity/v3/projects/4cad1631f8314a8f96875e3f33a2fad9/users/3110b4fa482c46439aba90f75658b5cd/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:56:26.301790 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafdd35-820a-4e9f-ba1f-0c9561fc3557 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:26.302126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafdd35-820a-4e9f-ba1f-0c9561fc3557 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:26.302417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafdd35-820a-4e9f-ba1f-0c9561fc3557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:26.328865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-fcafdd35-820a-4e9f-ba1f-0c9561fc3557 None None] MFA Rules not processed for user `3110b4fa482c46439aba90f75658b5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:26.330062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-fcafdd35-820a-4e9f-ba1f-0c9561fc3557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:26.398257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1304/2650] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:26.409480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f16a6-a0dc-4845-be63-2cf7e6365ba5 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:26.411500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-216f16a6-a0dc-4845-be63-2cf7e6365ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:26.468583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f16a6-a0dc-4845-be63-2cf7e6365ba5 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:26.472369 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444dff6-cfa0-4366-9161-7917223bbc42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:26.472950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444dff6-cfa0-4366-9161-7917223bbc42 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:26.473234 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444dff6-cfa0-4366-9161-7917223bbc42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:26.473510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444dff6-cfa0-4366-9161-7917223bbc42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:26.482832 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444dff6-cfa0-4366-9161-7917223bbc42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:26.484253 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444dff6-cfa0-4366-9161-7917223bbc42 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:26.494181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1347/2651] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:26.843650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafdd35-820a-4e9f-ba1f-0c9561fc3557 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:26.906689 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafdd35-820a-4e9f-ba1f-0c9561fc3557 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:26.911423 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:26.912274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:26.912548 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:26.912820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] PATH_INFO: `/v3/users/3682b25e4cd349939ba6c64c3b75fa2a` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:26.913986 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3682b25e4cd349939ba6c64c3b75fa2a)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:26.916439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:26.961376 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3682b25e4cd349939ba6c64c3b75fa2a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:26.973709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3682b25e4cd349939ba6c64c3b75fa2a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:26.974340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3682b25e4cd349939ba6c64c3b75fa2a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:26.981954 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3682b25e4cd349939ba6c64c3b75fa2a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:26.983589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:26.990555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3682b25e4cd349939ba6c64c3b75fa2a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:26.997408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1305/2652] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:26 2022] DELETE /identity/v3/users/3682b25e4cd349939ba6c64c3b75fa2a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:27.001955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d3da4-5345-43af-b5db-26e79c5a5357 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:27.002494 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d3da4-5345-43af-b5db-26e79c5a5357 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:27.002594 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d3da4-5345-43af-b5db-26e79c5a5357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:27.020580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-bf3d3da4-5345-43af-b5db-26e79c5a5357 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:27.021767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bf3d3da4-5345-43af-b5db-26e79c5a5357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:27.066197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:27.082691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1348/2653] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:27.092511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:27.093894 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:27.151020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e80a21-74d8-4a57-a967-a3f88271994d admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:27.155264 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf5d3-b8e8-4f2d-b36d-eebc5b5228cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:27.155911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf5d3-b8e8-4f2d-b36d-eebc5b5228cf service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:27.156189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf5d3-b8e8-4f2d-b36d-eebc5b5228cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:27.156461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcf5d3-b8e8-4f2d-b36d-eebc5b5228cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:27.166861 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcf5d3-b8e8-4f2d-b36d-eebc5b5228cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:27.168434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcf5d3-b8e8-4f2d-b36d-eebc5b5228cf service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:27.178421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1306/2654] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:27.474363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d3da4-5345-43af-b5db-26e79c5a5357 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:27.476531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-bf3d3da4-5345-43af-b5db-26e79c5a5357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:27.492854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d3da4-5345-43af-b5db-26e79c5a5357 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:27.510795 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:27.511786 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:27.512168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:27.513199 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] PATH_INFO: `/v3/projects/811799f18faa498395c7cf6dce530114` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:27.514172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] RBAC: Authorizing `identity:delete_project(project_id=811799f18faa498395c7cf6dce530114)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:27.519449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:27.573865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811799f18faa498395c7cf6dce530114', 'request_id': 'req-1f0f9426-1f19-4971-afd3-ad422463a69f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.580257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811799f18faa498395c7cf6dce530114', 'request_id': 'req-1f0f9426-1f19-4971-afd3-ad422463a69f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.588141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811799f18faa498395c7cf6dce530114', 'request_id': 'req-1f0f9426-1f19-4971-afd3-ad422463a69f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.599162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] The token cache is being invalidate because project 811799f18faa498395c7cf6dce530114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:27.599446 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.600073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.601607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1349/2655] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:27 2022] DELETE /identity/v3/projects/811799f18faa498395c7cf6dce530114 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:27.606208 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf5d3-b8e8-4f2d-b36d-eebc5b5228cf service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:27.615875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcf5d3-b8e8-4f2d-b36d-eebc5b5228cf service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:27.674641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:27.675506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:27.675789 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:27.676109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] PATH_INFO: `/v3/users/3110b4fa482c46439aba90f75658b5cd` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:27.677430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3110b4fa482c46439aba90f75658b5cd)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:27.679438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:27.727010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3110b4fa482c46439aba90f75658b5cd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.739427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3110b4fa482c46439aba90f75658b5cd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.740043 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3110b4fa482c46439aba90f75658b5cd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.747408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3110b4fa482c46439aba90f75658b5cd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.756209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-15357d88-4b60-4598-820c-fbd30f4f34f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3110b4fa482c46439aba90f75658b5cd'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:27.762346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1307/2656] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:27 2022] DELETE /identity/v3/users/3110b4fa482c46439aba90f75658b5cd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:28.035655 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:28.037098 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:28.051067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f9426-1f19-4971-afd3-ad422463a69f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:28.109541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:28.110445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.110733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.111013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] PATH_INFO: `/v3/projects/4cad1631f8314a8f96875e3f33a2fad9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.112207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cad1631f8314a8f96875e3f33a2fad9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:28.114107 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:28.161686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cad1631f8314a8f96875e3f33a2fad9', 'request_id': 'req-08128dca-a6c5-4bba-88bd-0cc8baea1615'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:28.168772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cad1631f8314a8f96875e3f33a2fad9', 'request_id': 'req-08128dca-a6c5-4bba-88bd-0cc8baea1615'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:28.176528 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cad1631f8314a8f96875e3f33a2fad9', 'request_id': 'req-08128dca-a6c5-4bba-88bd-0cc8baea1615'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:28.187003 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] The token cache is being invalidate because project 4cad1631f8314a8f96875e3f33a2fad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:28.187291 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:28.187920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-08128dca-a6c5-4bba-88bd-0cc8baea1615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:28.189461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1350/2657] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:28 2022] DELETE /identity/v3/projects/4cad1631f8314a8f96875e3f33a2fad9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:28.194270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ce5a6-33c2-427d-8e50-6d83bcebd066 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.194758 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ce5a6-33c2-427d-8e50-6d83bcebd066 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.194870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ce5a6-33c2-427d-8e50-6d83bcebd066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.218663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-817ce5a6-33c2-427d-8e50-6d83bcebd066 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:28.219878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-817ce5a6-33c2-427d-8e50-6d83bcebd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:28.229109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:28.288209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1308/2658] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:28.297460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ee24b-4828-46f7-aa9f-2268d932c44e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.297749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ee24b-4828-46f7-aa9f-2268d932c44e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.298050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ee24b-4828-46f7-aa9f-2268d932c44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.304527 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:28.319042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-110ee24b-4828-46f7-aa9f-2268d932c44e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:28.320249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-110ee24b-4828-46f7-aa9f-2268d932c44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:28.328222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1351/2659] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:28.332811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ce5a6-33c2-427d-8e50-6d83bcebd066 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:28.342982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ce5a6-33c2-427d-8e50-6d83bcebd066 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:28.347886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d207973-68cd-4776-9186-d5638cb1c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:28.348535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d207973-68cd-4776-9186-d5638cb1c372 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.348815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d207973-68cd-4776-9186-d5638cb1c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.349093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d207973-68cd-4776-9186-d5638cb1c372 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.349824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d207973-68cd-4776-9186-d5638cb1c372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:28.350200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d207973-68cd-4776-9186-d5638cb1c372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:28.351934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d207973-68cd-4776-9186-d5638cb1c372 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:28.365147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1309/2660] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:28.370026 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ee24b-4828-46f7-aa9f-2268d932c44e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:28.379778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ee24b-4828-46f7-aa9f-2268d932c44e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:28.385460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58390f1f-e8fd-4594-a448-63585b0918bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:28.386110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58390f1f-e8fd-4594-a448-63585b0918bf admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.386423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58390f1f-e8fd-4594-a448-63585b0918bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.386694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58390f1f-e8fd-4594-a448-63585b0918bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.387389 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58390f1f-e8fd-4594-a448-63585b0918bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:28.389264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58390f1f-e8fd-4594-a448-63585b0918bf admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:28.415496 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1352/2661] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:28 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:56:28.419880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d207973-68cd-4776-9186-d5638cb1c372 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:28.430111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d207973-68cd-4776-9186-d5638cb1c372 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:28.486019 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84d6b9-14f3-4d2b-a3bf-098fdd81d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:28.486711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84d6b9-14f3-4d2b-a3bf-098fdd81d5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.486997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84d6b9-14f3-4d2b-a3bf-098fdd81d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.487276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84d6b9-14f3-4d2b-a3bf-098fdd81d5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.487973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84d6b9-14f3-4d2b-a3bf-098fdd81d5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:28.489887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84d6b9-14f3-4d2b-a3bf-098fdd81d5f4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:28.510636 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1310/2662] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:28 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:56:28.514652 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58390f1f-e8fd-4594-a448-63585b0918bf admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:28.525637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58390f1f-e8fd-4594-a448-63585b0918bf admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:28.530240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83a388-3e2c-4974-a582-8bea1b0df66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:28.530928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83a388-3e2c-4974-a582-8bea1b0df66a admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.531209 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83a388-3e2c-4974-a582-8bea1b0df66a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.531481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83a388-3e2c-4974-a582-8bea1b0df66a admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.532195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83a388-3e2c-4974-a582-8bea1b0df66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:28.533754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83a388-3e2c-4974-a582-8bea1b0df66a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:28.545124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1353/2663] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:28.549162 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84d6b9-14f3-4d2b-a3bf-098fdd81d5f4 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:28.559763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84d6b9-14f3-4d2b-a3bf-098fdd81d5f4 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:28.564393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422663b-4666-4b2f-976c-7db173c7f1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:28.565074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422663b-4666-4b2f-976c-7db173c7f1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.565372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422663b-4666-4b2f-976c-7db173c7f1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.565622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422663b-4666-4b2f-976c-7db173c7f1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.566330 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422663b-4666-4b2f-976c-7db173c7f1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:28.568061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422663b-4666-4b2f-976c-7db173c7f1b1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:28.579038 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1311/2664] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:28.583190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83a388-3e2c-4974-a582-8bea1b0df66a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:28.593630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83a388-3e2c-4974-a582-8bea1b0df66a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:28.598333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa428-9a4a-4f46-8ec2-9c5100bf0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:28.599239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa428-9a4a-4f46-8ec2-9c5100bf0679 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.599502 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa428-9a4a-4f46-8ec2-9c5100bf0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.599772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa428-9a4a-4f46-8ec2-9c5100bf0679 admin admin] PATH_INFO: `/v3/projects/a66f388389a442ad985efaa5b44b2c10/users/00c8f7566d04435eaed9fa55a43848e4/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.614848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aa428-9a4a-4f46-8ec2-9c5100bf0679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66f388389a442ad985efaa5b44b2c10, user_id=00c8f7566d04435eaed9fa55a43848e4, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:28.617468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aa428-9a4a-4f46-8ec2-9c5100bf0679 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:28.631548 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1354/2665] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:28 2022] PUT /identity/v3/projects/a66f388389a442ad985efaa5b44b2c10/users/00c8f7566d04435eaed9fa55a43848e4/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:28.642279 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e1f2-343f-43f2-91b1-58a537b2c5da None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.642970 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e1f2-343f-43f2-91b1-58a537b2c5da None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.643260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e1f2-343f-43f2-91b1-58a537b2c5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.671910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f8c4e1f2-343f-43f2-91b1-58a537b2c5da None None] MFA Rules not processed for user `00c8f7566d04435eaed9fa55a43848e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:28.673460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f8c4e1f2-343f-43f2-91b1-58a537b2c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:28.744105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1312/2666] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:28.755650 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa428-9a4a-4f46-8ec2-9c5100bf0679 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:28.757921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3c0aa428-9a4a-4f46-8ec2-9c5100bf0679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:28.824777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa428-9a4a-4f46-8ec2-9c5100bf0679 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:28.829127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a8710-c198-40e2-bf7f-ab3cedaf3083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:28.829802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a8710-c198-40e2-bf7f-ab3cedaf3083 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.830086 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a8710-c198-40e2-bf7f-ab3cedaf3083 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.830456 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a8710-c198-40e2-bf7f-ab3cedaf3083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.839606 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a8710-c198-40e2-bf7f-ab3cedaf3083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:28.841050 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a8710-c198-40e2-bf7f-ab3cedaf3083 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:28.850539 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1355/2667] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:28.880430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4e1f2-343f-43f2-91b1-58a537b2c5da None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:28.890126 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:28.949632 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4e1f2-343f-43f2-91b1-58a537b2c5da None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:28.954140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:28.955084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:28.955382 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:28.955653 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] PATH_INFO: `/v3/users/00c8f7566d04435eaed9fa55a43848e4` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:28.956909 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c8f7566d04435eaed9fa55a43848e4)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:28.959139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:29.004767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c8f7566d04435eaed9fa55a43848e4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.016855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c8f7566d04435eaed9fa55a43848e4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.017544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c8f7566d04435eaed9fa55a43848e4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.024905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c8f7566d04435eaed9fa55a43848e4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.032887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c8f7566d04435eaed9fa55a43848e4'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.039416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1313/2668] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:28 2022] DELETE /identity/v3/users/00c8f7566d04435eaed9fa55a43848e4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:29.044520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90634e76-dc86-473f-86e2-2a35cdc5b350 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.045034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90634e76-dc86-473f-86e2-2a35cdc5b350 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.045132 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90634e76-dc86-473f-86e2-2a35cdc5b350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.063241 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-90634e76-dc86-473f-86e2-2a35cdc5b350 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:29.064361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-90634e76-dc86-473f-86e2-2a35cdc5b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:29.124105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1356/2669] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:29.134613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:29.136029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:29.195849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8a721-f785-4a5e-8e3c-ec7196ccb12d admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:29.200109 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b265fc2-70f5-494a-b659-6d00c37cd712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:29.200756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265fc2-70f5-494a-b659-6d00c37cd712 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.201040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265fc2-70f5-494a-b659-6d00c37cd712 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.201319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265fc2-70f5-494a-b659-6d00c37cd712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.210530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b265fc2-70f5-494a-b659-6d00c37cd712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:29.212545 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b265fc2-70f5-494a-b659-6d00c37cd712 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:29.222065 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1314/2670] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:29.487472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90634e76-dc86-473f-86e2-2a35cdc5b350 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:29.488896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-90634e76-dc86-473f-86e2-2a35cdc5b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:29.513091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90634e76-dc86-473f-86e2-2a35cdc5b350 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:29.517788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:29.518692 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.518973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.519252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] PATH_INFO: `/v3/projects/a66f388389a442ad985efaa5b44b2c10` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.520432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66f388389a442ad985efaa5b44b2c10)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:29.522325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:29.562478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:29.574349 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66f388389a442ad985efaa5b44b2c10', 'request_id': 'req-702f91d0-5577-4ee4-9409-81af6f163eed'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.580595 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66f388389a442ad985efaa5b44b2c10', 'request_id': 'req-702f91d0-5577-4ee4-9409-81af6f163eed'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.588052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66f388389a442ad985efaa5b44b2c10', 'request_id': 'req-702f91d0-5577-4ee4-9409-81af6f163eed'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.598700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] The token cache is being invalidate because project a66f388389a442ad985efaa5b44b2c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:29.598988 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.599615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-702f91d0-5577-4ee4-9409-81af6f163eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:29.601194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1357/2671] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:29 2022] DELETE /identity/v3/projects/a66f388389a442ad985efaa5b44b2c10 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:29.606058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736f4f-d7c3-4e66-9323-8e8c54eb020e None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.606340 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736f4f-d7c3-4e66-9323-8e8c54eb020e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.606650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736f4f-d7c3-4e66-9323-8e8c54eb020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.624536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7f736f4f-d7c3-4e66-9323-8e8c54eb020e None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:29.625724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7f736f4f-d7c3-4e66-9323-8e8c54eb020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:29.653713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:29.691838 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1315/2672] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:29.704182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7fa8-90ad-42b6-9095-8d2face7e524 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.704586 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7fa8-90ad-42b6-9095-8d2face7e524 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.704909 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7fa8-90ad-42b6-9095-8d2face7e524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.729284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-618c7fa8-90ad-42b6-9095-8d2face7e524 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:29.731197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-618c7fa8-90ad-42b6-9095-8d2face7e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:29.739252 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1358/2673] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:29.744022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f736f4f-d7c3-4e66-9323-8e8c54eb020e None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:29.753720 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f736f4f-d7c3-4e66-9323-8e8c54eb020e None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:29.758281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfa279-16cc-4edf-a090-6b69fd7ebb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:29.759489 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfa279-16cc-4edf-a090-6b69fd7ebb18 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.759770 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfa279-16cc-4edf-a090-6b69fd7ebb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.760045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfa279-16cc-4edf-a090-6b69fd7ebb18 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.760771 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfa279-16cc-4edf-a090-6b69fd7ebb18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:29.761082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfa279-16cc-4edf-a090-6b69fd7ebb18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:29.762709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfa279-16cc-4edf-a090-6b69fd7ebb18 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:29.774926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1316/2674] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:29.779419 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7fa8-90ad-42b6-9095-8d2face7e524 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:29.788802 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7fa8-90ad-42b6-9095-8d2face7e524 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:29.793553 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9c2e9-7e3e-413a-93ca-f16f4572a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:29.794200 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9c2e9-7e3e-413a-93ca-f16f4572a303 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.794521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9c2e9-7e3e-413a-93ca-f16f4572a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.794803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9c2e9-7e3e-413a-93ca-f16f4572a303 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.795484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9c2e9-7e3e-413a-93ca-f16f4572a303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:29.797367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9c2e9-7e3e-413a-93ca-f16f4572a303 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:29.824495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1359/2675] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:29 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:56:29.828708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfa279-16cc-4edf-a090-6b69fd7ebb18 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:29.839288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfa279-16cc-4edf-a090-6b69fd7ebb18 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:29.895602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02850ea-6020-48f9-8f5e-a8427cda9fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:29.896293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02850ea-6020-48f9-8f5e-a8427cda9fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.896575 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02850ea-6020-48f9-8f5e-a8427cda9fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.896852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02850ea-6020-48f9-8f5e-a8427cda9fe0 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.897547 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02850ea-6020-48f9-8f5e-a8427cda9fe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:29.899500 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02850ea-6020-48f9-8f5e-a8427cda9fe0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:29.919608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1317/2676] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:29 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:29.923806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9c2e9-7e3e-413a-93ca-f16f4572a303 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:29.937905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9c2e9-7e3e-413a-93ca-f16f4572a303 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:29.942713 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e1c78-0a34-445c-adbc-127d93b49fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:29.943380 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e1c78-0a34-445c-adbc-127d93b49fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.943665 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e1c78-0a34-445c-adbc-127d93b49fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.943942 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e1c78-0a34-445c-adbc-127d93b49fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.944698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e1c78-0a34-445c-adbc-127d93b49fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:29.946361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e1c78-0a34-445c-adbc-127d93b49fd0 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:29.957247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1360/2677] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:29.961308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02850ea-6020-48f9-8f5e-a8427cda9fe0 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:29.971721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02850ea-6020-48f9-8f5e-a8427cda9fe0 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:29.976821 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d35596-bb94-4137-939c-be79ba9be792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:29.978010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d35596-bb94-4137-939c-be79ba9be792 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:29.978285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d35596-bb94-4137-939c-be79ba9be792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:29.978589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d35596-bb94-4137-939c-be79ba9be792 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:29.979317 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d35596-bb94-4137-939c-be79ba9be792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:29.981336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d35596-bb94-4137-939c-be79ba9be792 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:29.993675 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1318/2678] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:29.997612 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e1c78-0a34-445c-adbc-127d93b49fd0 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:30.007423 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e1c78-0a34-445c-adbc-127d93b49fd0 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:30.012267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e97d3-d8a7-4264-90ab-ac9d17b58add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:30.013135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e97d3-d8a7-4264-90ab-ac9d17b58add admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:30.013413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e97d3-d8a7-4264-90ab-ac9d17b58add admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:30.013683 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e97d3-d8a7-4264-90ab-ac9d17b58add admin admin] PATH_INFO: `/v3/projects/33ea7566e2e64889ab9b937558497930/users/b3d2b35820f84d4ca08408aa6132c99e/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:30.028560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e97d3-d8a7-4264-90ab-ac9d17b58add admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ea7566e2e64889ab9b937558497930, user_id=b3d2b35820f84d4ca08408aa6132c99e, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:30.031222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e97d3-d8a7-4264-90ab-ac9d17b58add admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:30.046355 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1361/2679] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:29 2022] PUT /identity/v3/projects/33ea7566e2e64889ab9b937558497930/users/b3d2b35820f84d4ca08408aa6132c99e/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:30.057833 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d3b70-492d-408f-933b-c68d0e108129 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:30.058125 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d3b70-492d-408f-933b-c68d0e108129 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:30.058496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d3b70-492d-408f-933b-c68d0e108129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:30.085766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-7a8d3b70-492d-408f-933b-c68d0e108129 None None] MFA Rules not processed for user `b3d2b35820f84d4ca08408aa6132c99e`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:30.086971 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7a8d3b70-492d-408f-933b-c68d0e108129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:30.155334 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1319/2680] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:30.167184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e97d3-d8a7-4264-90ab-ac9d17b58add admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:30.168956 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-292e97d3-d8a7-4264-90ab-ac9d17b58add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:30.252545 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e97d3-d8a7-4264-90ab-ac9d17b58add admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:30.256800 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7dcc3-e0f1-43fb-9052-a9e15c7ae065 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb359ac9b084b38b77923219f42f655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:30.257608 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7dcc3-e0f1-43fb-9052-a9e15c7ae065 service glance] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:30.258001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7dcc3-e0f1-43fb-9052-a9e15c7ae065 service glance] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:30.258406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7dcc3-e0f1-43fb-9052-a9e15c7ae065 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:30.272589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7dcc3-e0f1-43fb-9052-a9e15c7ae065 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:30.274182 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7dcc3-e0f1-43fb-9052-a9e15c7ae065 service glance] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:30.284899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1362/2681] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:35.942439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d3b70-492d-408f-933b-c68d0e108129 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:35.943920 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7a8d3b70-492d-408f-933b-c68d0e108129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:35.980169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:36.022529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d3b70-492d-408f-933b-c68d0e108129 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:36.027705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:36.028581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:36.028864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:36.029140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] PATH_INFO: `/v3/users/52b32810724c46778ae6bd6e309f3524` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:36.030342 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b32810724c46778ae6bd6e309f3524)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:36.032304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:36.081661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b32810724c46778ae6bd6e309f3524'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.103274 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b32810724c46778ae6bd6e309f3524'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.104090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b32810724c46778ae6bd6e309f3524'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.111333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b32810724c46778ae6bd6e309f3524'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.119243 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b32810724c46778ae6bd6e309f3524'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.126369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1320/2682] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:35 2022] DELETE /identity/v3/users/52b32810724c46778ae6bd6e309f3524 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:36.130904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda5642-e3ac-4a46-8e33-fa97acbf0289 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:36.131590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda5642-e3ac-4a46-8e33-fa97acbf0289 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:36.131590 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda5642-e3ac-4a46-8e33-fa97acbf0289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:36.151018 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-1fda5642-e3ac-4a46-8e33-fa97acbf0289 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:36.152230 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1fda5642-e3ac-4a46-8e33-fa97acbf0289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:36.219106 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1363/2683] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:36.230528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:36.232288 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:36.306409 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6ff94-7555-4bce-ac32-6a409bb66d4b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:36.310278 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34a4a0-70ca-499e-8107-cc5df242d81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:36.310958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34a4a0-70ca-499e-8107-cc5df242d81e service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:36.311239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34a4a0-70ca-499e-8107-cc5df242d81e service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:36.311536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34a4a0-70ca-499e-8107-cc5df242d81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:36.321923 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34a4a0-70ca-499e-8107-cc5df242d81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:36.323397 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34a4a0-70ca-499e-8107-cc5df242d81e service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:36.333439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1321/2684] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:36.642684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda5642-e3ac-4a46-8e33-fa97acbf0289 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:36.644990 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1fda5642-e3ac-4a46-8e33-fa97acbf0289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:36.660836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda5642-e3ac-4a46-8e33-fa97acbf0289 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:36.661503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:36.668818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:36.670014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:36.670580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:36.671223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] PATH_INFO: `/v3/projects/d0cb97719e694c879126f2a708fec563` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:36.672997 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0cb97719e694c879126f2a708fec563)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:36.675235 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:36.729207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0cb97719e694c879126f2a708fec563', 'request_id': 'req-e238f916-dae7-4593-a184-fff7f884d8d1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.735883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0cb97719e694c879126f2a708fec563', 'request_id': 'req-e238f916-dae7-4593-a184-fff7f884d8d1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.744935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0cb97719e694c879126f2a708fec563', 'request_id': 'req-e238f916-dae7-4593-a184-fff7f884d8d1'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.756510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] The token cache is being invalidate because project d0cb97719e694c879126f2a708fec563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:36.756796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.757563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e238f916-dae7-4593-a184-fff7f884d8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:36.759188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1364/2685] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:36 2022] DELETE /identity/v3/projects/d0cb97719e694c879126f2a708fec563 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:36.764059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97069f8-4090-4368-b4f4-a1c48723d88f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:36.764341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97069f8-4090-4368-b4f4-a1c48723d88f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:36.764668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97069f8-4090-4368-b4f4-a1c48723d88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:36.782623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-e97069f8-4090-4368-b4f4-a1c48723d88f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:36.783803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e97069f8-4090-4368-b4f4-a1c48723d88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:36.830861 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:36.853172 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1322/2686] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:36.861712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9448-0465-40b1-9d72-e99b235640a2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:36.861999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9448-0465-40b1-9d72-e99b235640a2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:36.862352 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9448-0465-40b1-9d72-e99b235640a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:36.880884 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-a94b9448-0465-40b1-9d72-e99b235640a2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:36.882068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a94b9448-0465-40b1-9d72-e99b235640a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:36.891574 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1365/2687] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:36.895834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97069f8-4090-4368-b4f4-a1c48723d88f None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:36.905647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97069f8-4090-4368-b4f4-a1c48723d88f None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:36.910525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fea5ed-958b-4581-bbff-d038b67a4fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:36.911171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fea5ed-958b-4581-bbff-d038b67a4fbd admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:36.911458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fea5ed-958b-4581-bbff-d038b67a4fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:36.911737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fea5ed-958b-4581-bbff-d038b67a4fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:36.912495 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fea5ed-958b-4581-bbff-d038b67a4fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:36.912803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fea5ed-958b-4581-bbff-d038b67a4fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:36.914919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fea5ed-958b-4581-bbff-d038b67a4fbd admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:36.926616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1323/2688] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:36.931482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9448-0465-40b1-9d72-e99b235640a2 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:36.940580 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9448-0465-40b1-9d72-e99b235640a2 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:36.946397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491fe55-695e-467c-9feb-d92fe63b65df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:36.947221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491fe55-695e-467c-9feb-d92fe63b65df admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:36.947506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491fe55-695e-467c-9feb-d92fe63b65df admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:36.947848 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491fe55-695e-467c-9feb-d92fe63b65df admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:36.949391 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491fe55-695e-467c-9feb-d92fe63b65df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:36.951342 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491fe55-695e-467c-9feb-d92fe63b65df admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:36.979387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1366/2689] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:36 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:56:36.983524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fea5ed-958b-4581-bbff-d038b67a4fbd admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:36.996589 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fea5ed-958b-4581-bbff-d038b67a4fbd admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:37.056668 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30cc6-d512-4f33-a55c-79e0c3f7137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:37.057449 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30cc6-d512-4f33-a55c-79e0c3f7137b admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:37.057690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30cc6-d512-4f33-a55c-79e0c3f7137b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:37.058027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30cc6-d512-4f33-a55c-79e0c3f7137b admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:37.058752 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e30cc6-d512-4f33-a55c-79e0c3f7137b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:37.060660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e30cc6-d512-4f33-a55c-79e0c3f7137b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:37.081369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1324/2690] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:36 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:37.085996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491fe55-695e-467c-9feb-d92fe63b65df admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:37.096873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491fe55-695e-467c-9feb-d92fe63b65df admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:37.101428 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907dab0-949f-4a19-8ebe-7fc777313e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:37.102656 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907dab0-949f-4a19-8ebe-7fc777313e89 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:37.102940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907dab0-949f-4a19-8ebe-7fc777313e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:37.103215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907dab0-949f-4a19-8ebe-7fc777313e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:37.103939 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907dab0-949f-4a19-8ebe-7fc777313e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:37.105513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907dab0-949f-4a19-8ebe-7fc777313e89 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:37.115613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1367/2691] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:37.119656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30cc6-d512-4f33-a55c-79e0c3f7137b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:37.131260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30cc6-d512-4f33-a55c-79e0c3f7137b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:37.136179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae2337-f8bf-4c7e-a14e-bb631f3374cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:37.137018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae2337-f8bf-4c7e-a14e-bb631f3374cb admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:37.137300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae2337-f8bf-4c7e-a14e-bb631f3374cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:37.137573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae2337-f8bf-4c7e-a14e-bb631f3374cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:37.138304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae2337-f8bf-4c7e-a14e-bb631f3374cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:37.139930 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae2337-f8bf-4c7e-a14e-bb631f3374cb admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:37.151113 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1325/2692] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:37.155122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907dab0-949f-4a19-8ebe-7fc777313e89 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:37.165856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907dab0-949f-4a19-8ebe-7fc777313e89 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:37.171283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8a6ae-c953-46c1-af73-37106a626a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:37.172305 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8a6ae-c953-46c1-af73-37106a626a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:37.172583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8a6ae-c953-46c1-af73-37106a626a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:37.173160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8a6ae-c953-46c1-af73-37106a626a44 admin admin] PATH_INFO: `/v3/projects/8ce728c069fe4e179ba4c4790fd25a60/users/a5dc55fb9e0c4630b2852470239b20c6/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:37.189704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8a6ae-c953-46c1-af73-37106a626a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce728c069fe4e179ba4c4790fd25a60, user_id=a5dc55fb9e0c4630b2852470239b20c6, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:37.192401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8a6ae-c953-46c1-af73-37106a626a44 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:37.205271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1368/2693] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:37 2022] PUT /identity/v3/projects/8ce728c069fe4e179ba4c4790fd25a60/users/a5dc55fb9e0c4630b2852470239b20c6/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:37.216082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17709-060c-482d-a179-e78c65338cda None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:37.216374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17709-060c-482d-a179-e78c65338cda None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:37.216655 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17709-060c-482d-a179-e78c65338cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:37.247286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-35d17709-060c-482d-a179-e78c65338cda None None] MFA Rules not processed for user `a5dc55fb9e0c4630b2852470239b20c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:37.247286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-35d17709-060c-482d-a179-e78c65338cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:37.312983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1326/2694] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 18:56:37.327272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8a6ae-c953-46c1-af73-37106a626a44 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:37.329131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-8db8a6ae-c953-46c1-af73-37106a626a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:37.389880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8a6ae-c953-46c1-af73-37106a626a44 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:37.393533 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5831-1bf5-46f9-9d36-6943ecb336b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:37.394173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5831-1bf5-46f9-9d36-6943ecb336b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:37.394481 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5831-1bf5-46f9-9d36-6943ecb336b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:37.394758 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5831-1bf5-46f9-9d36-6943ecb336b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:37.404437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5831-1bf5-46f9-9d36-6943ecb336b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:37.405857 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5831-1bf5-46f9-9d36-6943ecb336b5 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:37.414979 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1369/2695] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:47.310060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:47.411068 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:53.857866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17709-060c-482d-a179-e78c65338cda None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:53.859625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-35d17709-060c-482d-a179-e78c65338cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:53.926989 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17709-060c-482d-a179-e78c65338cda None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:53.932081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:53.932961 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:53.933240 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:53.933511 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] PATH_INFO: `/v3/users/b3d2b35820f84d4ca08408aa6132c99e` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:53.934732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d2b35820f84d4ca08408aa6132c99e)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:53.936666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:53.986897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d2b35820f84d4ca08408aa6132c99e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:53.999200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d2b35820f84d4ca08408aa6132c99e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:53.999909 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d2b35820f84d4ca08408aa6132c99e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:54.007380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d2b35820f84d4ca08408aa6132c99e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:54.015410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d2b35820f84d4ca08408aa6132c99e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:54.021629 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1327/2696] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:53 2022] DELETE /identity/v3/users/b3d2b35820f84d4ca08408aa6132c99e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:54.026336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bba994-d66c-46f7-8966-636c3ffd548f None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:54.026865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bba994-d66c-46f7-8966-636c3ffd548f None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:54.026974 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bba994-d66c-46f7-8966-636c3ffd548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:54.046708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-f1bba994-d66c-46f7-8966-636c3ffd548f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:54.047934 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f1bba994-d66c-46f7-8966-636c3ffd548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:54.109295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1370/2697] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:54.119551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:54.121073 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:54.178439 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9f187-67a5-4c30-8578-2d42ce72c6ab admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:54.182721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e3b3a-f322-4609-869f-bc9506afafa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:54.183366 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e3b3a-f322-4609-869f-bc9506afafa4 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:54.183627 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e3b3a-f322-4609-869f-bc9506afafa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:54.183910 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e3b3a-f322-4609-869f-bc9506afafa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:54.194699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e3b3a-f322-4609-869f-bc9506afafa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:54.196189 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e3b3a-f322-4609-869f-bc9506afafa4 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:54.205929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1328/2698] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:54.496216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bba994-d66c-46f7-8966-636c3ffd548f None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:54.504834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f1bba994-d66c-46f7-8966-636c3ffd548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:54.526410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bba994-d66c-46f7-8966-636c3ffd548f None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:54.531560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:54.532584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:54.532937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:54.533285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] PATH_INFO: `/v3/projects/33ea7566e2e64889ab9b937558497930` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:54.534879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ea7566e2e64889ab9b937558497930)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:54.536875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:54.594064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ea7566e2e64889ab9b937558497930', 'request_id': 'req-35ecac5f-9448-41bc-9516-6e3709727386'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:54.601836 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ea7566e2e64889ab9b937558497930', 'request_id': 'req-35ecac5f-9448-41bc-9516-6e3709727386'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:54.610084 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ea7566e2e64889ab9b937558497930', 'request_id': 'req-35ecac5f-9448-41bc-9516-6e3709727386'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:54.620517 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] The token cache is being invalidate because project 33ea7566e2e64889ab9b937558497930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:54.620799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:54.621416 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-35ecac5f-9448-41bc-9516-6e3709727386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:54.623175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1371/2699] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:54 2022] DELETE /identity/v3/projects/33ea7566e2e64889ab9b937558497930 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:54.628265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c12dd-e1ba-451f-be52-edde6b6b74de None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:54.628460 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c12dd-e1ba-451f-be52-edde6b6b74de None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:54.628736 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c12dd-e1ba-451f-be52-edde6b6b74de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:54.649572 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-456c12dd-e1ba-451f-be52-edde6b6b74de None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:54.650784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-456c12dd-e1ba-451f-be52-edde6b6b74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:54.669295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:54.731534 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1329/2700] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:54.739719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c58be1-f197-4238-9109-a1e02e28c040 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:54.740099 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c58be1-f197-4238-9109-a1e02e28c040 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:54.740400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c58be1-f197-4238-9109-a1e02e28c040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:54.759961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d0c58be1-f197-4238-9109-a1e02e28c040 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:54.761174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d0c58be1-f197-4238-9109-a1e02e28c040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:54.769185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1372/2701] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:54.774022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c12dd-e1ba-451f-be52-edde6b6b74de None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:54.783883 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c12dd-e1ba-451f-be52-edde6b6b74de None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:54.788870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed141a-49e0-4ece-8085-0fa39ddb10ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:54.789535 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed141a-49e0-4ece-8085-0fa39ddb10ca admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:54.789817 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed141a-49e0-4ece-8085-0fa39ddb10ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:54.790121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed141a-49e0-4ece-8085-0fa39ddb10ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:54.790892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed141a-49e0-4ece-8085-0fa39ddb10ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:56:54.791198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed141a-49e0-4ece-8085-0fa39ddb10ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:54.792805 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed141a-49e0-4ece-8085-0fa39ddb10ca admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:54.805250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1330/2702] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:56:54.809359 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c58be1-f197-4238-9109-a1e02e28c040 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:54.818685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c58be1-f197-4238-9109-a1e02e28c040 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:54.824404 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673473-d5bf-4f94-965c-ca3632bfc02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:54.825043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673473-d5bf-4f94-965c-ca3632bfc02a admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:54.825330 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673473-d5bf-4f94-965c-ca3632bfc02a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:54.825609 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673473-d5bf-4f94-965c-ca3632bfc02a admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:54.826552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b673473-d5bf-4f94-965c-ca3632bfc02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:54.828221 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b673473-d5bf-4f94-965c-ca3632bfc02a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:54.854118 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1373/2703] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:56:54 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:54.858507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed141a-49e0-4ece-8085-0fa39ddb10ca admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:54.872929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed141a-49e0-4ece-8085-0fa39ddb10ca admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:54.933310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f983cd5-428e-459c-8a48-49e709495fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:54.933980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f983cd5-428e-459c-8a48-49e709495fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:54.934270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f983cd5-428e-459c-8a48-49e709495fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:54.934580 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f983cd5-428e-459c-8a48-49e709495fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:54.935263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f983cd5-428e-459c-8a48-49e709495fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:54.937262 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f983cd5-428e-459c-8a48-49e709495fb2 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:54.961558 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1331/2704] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:56:54 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:56:54.962685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673473-d5bf-4f94-965c-ca3632bfc02a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:54.973399 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673473-d5bf-4f94-965c-ca3632bfc02a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:54.978772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba9ab1-55d1-4563-a827-16829b79e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:54.979468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba9ab1-55d1-4563-a827-16829b79e61a admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:54.979738 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba9ab1-55d1-4563-a827-16829b79e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:54.980017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba9ab1-55d1-4563-a827-16829b79e61a admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:54.980750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba9ab1-55d1-4563-a827-16829b79e61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:54.982437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba9ab1-55d1-4563-a827-16829b79e61a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:54.993907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1374/2705] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 18:56:54.998052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f983cd5-428e-459c-8a48-49e709495fb2 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.008412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f983cd5-428e-459c-8a48-49e709495fb2 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.013149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aa0ad-6df9-4e7d-ab00-1ed76a6984d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.013815 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aa0ad-6df9-4e7d-ab00-1ed76a6984d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.014105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aa0ad-6df9-4e7d-ab00-1ed76a6984d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.014412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aa0ad-6df9-4e7d-ab00-1ed76a6984d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.015147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aa0ad-6df9-4e7d-ab00-1ed76a6984d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.016749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aa0ad-6df9-4e7d-ab00-1ed76a6984d3 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:55.027463 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1332/2706] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:56:55.031636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba9ab1-55d1-4563-a827-16829b79e61a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.042923 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba9ab1-55d1-4563-a827-16829b79e61a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.047791 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e77464-8b58-4d03-9fd0-01c7c8328eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.048685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e77464-8b58-4d03-9fd0-01c7c8328eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.048971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e77464-8b58-4d03-9fd0-01c7c8328eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.049266 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e77464-8b58-4d03-9fd0-01c7c8328eaf admin admin] PATH_INFO: `/v3/projects/5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b/users/f7cb859c9a3a46dba0e123b4fa1f99ca/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.064872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e77464-8b58-4d03-9fd0-01c7c8328eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b, user_id=f7cb859c9a3a46dba0e123b4fa1f99ca, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.067630 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e77464-8b58-4d03-9fd0-01c7c8328eaf admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:55.081803 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1375/2707] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:56:55 2022] PUT /identity/v3/projects/5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b/users/f7cb859c9a3a46dba0e123b4fa1f99ca/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:55.093583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a9f84-29e1-4b90-8924-b23bdd88d005 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.093870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a9f84-29e1-4b90-8924-b23bdd88d005 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.094148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a9f84-29e1-4b90-8924-b23bdd88d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.122106 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-aa6a9f84-29e1-4b90-8924-b23bdd88d005 None None] MFA Rules not processed for user `f7cb859c9a3a46dba0e123b4fa1f99ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:55.123407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-aa6a9f84-29e1-4b90-8924-b23bdd88d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:55.196009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1333/2708] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:55.207280 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e77464-8b58-4d03-9fd0-01c7c8328eaf admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.209123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-64e77464-8b58-4d03-9fd0-01c7c8328eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:55.233682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:55.275710 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e77464-8b58-4d03-9fd0-01c7c8328eaf admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.280036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71100e47-0175-4dfb-82b5-351dcdec8c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.281190 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71100e47-0175-4dfb-82b5-351dcdec8c8f service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.281629 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71100e47-0175-4dfb-82b5-351dcdec8c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.282931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71100e47-0175-4dfb-82b5-351dcdec8c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.292941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71100e47-0175-4dfb-82b5-351dcdec8c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.294406 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71100e47-0175-4dfb-82b5-351dcdec8c8f service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:55.303143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1376/2709] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:55.329480 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a9f84-29e1-4b90-8924-b23bdd88d005 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.349701 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:55.396996 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a9f84-29e1-4b90-8924-b23bdd88d005 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.402084 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.402988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.403269 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.403542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] PATH_INFO: `/v3/users/f7cb859c9a3a46dba0e123b4fa1f99ca` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.404740 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cb859c9a3a46dba0e123b4fa1f99ca)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.406704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:55.457929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cb859c9a3a46dba0e123b4fa1f99ca'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.470425 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cb859c9a3a46dba0e123b4fa1f99ca'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.471100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cb859c9a3a46dba0e123b4fa1f99ca'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.478456 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cb859c9a3a46dba0e123b4fa1f99ca'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.486171 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cb859c9a3a46dba0e123b4fa1f99ca'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:55.492184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1334/2710] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:56:55 2022] DELETE /identity/v3/users/f7cb859c9a3a46dba0e123b4fa1f99ca => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:56:55.496825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7d7bb-461d-4a55-ae1b-913c7bf1d783 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.499435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7d7bb-461d-4a55-ae1b-913c7bf1d783 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.499435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7d7bb-461d-4a55-ae1b-913c7bf1d783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.520674 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-15d7d7bb-461d-4a55-ae1b-913c7bf1d783 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:56:55.521897 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-15d7d7bb-461d-4a55-ae1b-913c7bf1d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:55.583381 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1377/2711] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:56:55.595416 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.596809 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:55.658527 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aacb1-0e08-4dd7-8c66-3e5d6dc9434a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.662344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad1452-5b1d-43a0-926b-6a2807684982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.663009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1452-5b1d-43a0-926b-6a2807684982 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.663290 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1452-5b1d-43a0-926b-6a2807684982 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.663593 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad1452-5b1d-43a0-926b-6a2807684982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.672897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad1452-5b1d-43a0-926b-6a2807684982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.674724 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad1452-5b1d-43a0-926b-6a2807684982 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:55.685237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1335/2712] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:56:55.963676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7d7bb-461d-4a55-ae1b-913c7bf1d783 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:56:55.965164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-15d7d7bb-461d-4a55-ae1b-913c7bf1d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:56:55.977563 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7d7bb-461d-4a55-ae1b-913c7bf1d783 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:56:55.982492 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:56:55.983363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:56:55.983644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:56:55.983919 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] PATH_INFO: `/v3/projects/5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:56:55.985131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:56:55.987110 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:56:56.038498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b', 'request_id': 'req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.044844 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b', 'request_id': 'req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.052499 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b', 'request_id': 'req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.065489 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] The token cache is being invalidate because project 5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:56:56.065783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.066482 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6dd0289e-cf67-4c01-b68d-a6ccaecbd4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:56:56.068038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1378/2713] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:56:55 2022] DELETE /identity/v3/projects/5d0fc1d2f85d4b5d9c5e2e3e90c2fc3b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:05.680351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:06.062149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:08.104394 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad1452-5b1d-43a0-926b-6a2807684982 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:08.105807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-98ad1452-5b1d-43a0-926b-6a2807684982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.118503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad1452-5b1d-43a0-926b-6a2807684982 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:08.173934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:08.174824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:08.175104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:08.175377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] PATH_INFO: `/v3/users/a5dc55fb9e0c4630b2852470239b20c6` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:08.176574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5dc55fb9e0c4630b2852470239b20c6)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:08.178530 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:08.225312 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5dc55fb9e0c4630b2852470239b20c6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:08.238647 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5dc55fb9e0c4630b2852470239b20c6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:08.239415 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5dc55fb9e0c4630b2852470239b20c6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:08.246870 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5dc55fb9e0c4630b2852470239b20c6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:08.255408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5dc55fb9e0c4630b2852470239b20c6'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:08.263607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1336/2714] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:08 2022] DELETE /identity/v3/users/a5dc55fb9e0c4630b2852470239b20c6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:08.267955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de8641-a22d-459b-8ed7-bcdb57004b20 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:08.268344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de8641-a22d-459b-8ed7-bcdb57004b20 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:08.268565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de8641-a22d-459b-8ed7-bcdb57004b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:08.287289 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-78de8641-a22d-459b-8ed7-bcdb57004b20 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:08.288485 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-78de8641-a22d-459b-8ed7-bcdb57004b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.340458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:08.341867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.364348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1379/2715] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:08.374584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de8641-a22d-459b-8ed7-bcdb57004b20 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:08.376027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-78de8641-a22d-459b-8ed7-bcdb57004b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.401319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eebdf6-cee1-448a-9104-097641c12255 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:08.405012 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:08.405676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:08.405962 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:08.406237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:08.408102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:08.421275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:08.422886 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:08.433972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1337/2716] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:08.437312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de8641-a22d-459b-8ed7-bcdb57004b20 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:08.440952 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96ffdd-0eab-47cb-8e24-a1d446cf3065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:08.441603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96ffdd-0eab-47cb-8e24-a1d446cf3065 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:08.441883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96ffdd-0eab-47cb-8e24-a1d446cf3065 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:08.442157 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96ffdd-0eab-47cb-8e24-a1d446cf3065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:08.451781 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96ffdd-0eab-47cb-8e24-a1d446cf3065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:08.453208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96ffdd-0eab-47cb-8e24-a1d446cf3065 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:08.463591 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1380/2717] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:09.134726 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.136309 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:09.149873 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c234637-2732-4c01-8d6f-076cb56de39d service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.155046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.156046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.156378 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.156661 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] PATH_INFO: `/v3/projects/8ce728c069fe4e179ba4c4790fd25a60` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.157866 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce728c069fe4e179ba4c4790fd25a60)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.160380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.182829 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:09.216537 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce728c069fe4e179ba4c4790fd25a60', 'request_id': 'req-74391034-34ea-4d58-ace7-db761b833c3f'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.224230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce728c069fe4e179ba4c4790fd25a60', 'request_id': 'req-74391034-34ea-4d58-ace7-db761b833c3f'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.231306 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce728c069fe4e179ba4c4790fd25a60', 'request_id': 'req-74391034-34ea-4d58-ace7-db761b833c3f'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.243926 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] The token cache is being invalidate because project 8ce728c069fe4e179ba4c4790fd25a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:09.244219 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.244887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-74391034-34ea-4d58-ace7-db761b833c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:09.246582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1338/2718] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:09 2022] DELETE /identity/v3/projects/8ce728c069fe4e179ba4c4790fd25a60 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:09.253677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fdac0-d5ab-4515-95d6-928881df19ab None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.253975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fdac0-d5ab-4515-95d6-928881df19ab None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.258420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fdac0-d5ab-4515-95d6-928881df19ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.274589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d14fdac0-d5ab-4515-95d6-928881df19ab None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:09.275878 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d14fdac0-d5ab-4515-95d6-928881df19ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:09.338704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1381/2719] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:09.346597 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2299c-2e88-4cc6-a175-5a3f0df26df0 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.346887 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2299c-2e88-4cc6-a175-5a3f0df26df0 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.347181 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2299c-2e88-4cc6-a175-5a3f0df26df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.366576 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-4ca2299c-2e88-4cc6-a175-5a3f0df26df0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:09.367828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4ca2299c-2e88-4cc6-a175-5a3f0df26df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:09.377397 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1339/2720] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:09.382964 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fdac0-d5ab-4515-95d6-928881df19ab None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.392949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fdac0-d5ab-4515-95d6-928881df19ab None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.398097 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c528f-7ac1-443b-847d-876309f40c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.398787 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c528f-7ac1-443b-847d-876309f40c35 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.399074 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c528f-7ac1-443b-847d-876309f40c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.399484 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c528f-7ac1-443b-847d-876309f40c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.400220 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c528f-7ac1-443b-847d-876309f40c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:09.400531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c528f-7ac1-443b-847d-876309f40c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.402173 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c528f-7ac1-443b-847d-876309f40c35 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.414827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1382/2721] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:09.419071 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2299c-2e88-4cc6-a175-5a3f0df26df0 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.428908 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2299c-2e88-4cc6-a175-5a3f0df26df0 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.434045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb53e0-f1b2-40c7-a774-9e385f7952c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.434737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb53e0-f1b2-40c7-a774-9e385f7952c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.435026 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb53e0-f1b2-40c7-a774-9e385f7952c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.435303 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb53e0-f1b2-40c7-a774-9e385f7952c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.436077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb53e0-f1b2-40c7-a774-9e385f7952c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.438018 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb53e0-f1b2-40c7-a774-9e385f7952c6 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.466915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1340/2722] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:09 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:09.471057 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c528f-7ac1-443b-847d-876309f40c35 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.481510 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c528f-7ac1-443b-847d-876309f40c35 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.515153 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:09.546556 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92f04-5874-434d-8c3c-d7ca86b38bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.547411 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92f04-5874-434d-8c3c-d7ca86b38bbf admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.547691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92f04-5874-434d-8c3c-d7ca86b38bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.548035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92f04-5874-434d-8c3c-d7ca86b38bbf admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.548805 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d92f04-5874-434d-8c3c-d7ca86b38bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.550918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d92f04-5874-434d-8c3c-d7ca86b38bbf admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.577535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1383/2723] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:09 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:09.579010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb53e0-f1b2-40c7-a774-9e385f7952c6 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.590350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb53e0-f1b2-40c7-a774-9e385f7952c6 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.595319 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ba31-4923-445e-9fa9-42bd282fc185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.595871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ba31-4923-445e-9fa9-42bd282fc185 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.596155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ba31-4923-445e-9fa9-42bd282fc185 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.596427 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ba31-4923-445e-9fa9-42bd282fc185 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.597161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ba31-4923-445e-9fa9-42bd282fc185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.598893 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ba31-4923-445e-9fa9-42bd282fc185 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.611051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1341/2724] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:09.615283 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92f04-5874-434d-8c3c-d7ca86b38bbf admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.626226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92f04-5874-434d-8c3c-d7ca86b38bbf admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.631143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a1109-dc63-4352-8eef-89d0072862ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.631873 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a1109-dc63-4352-8eef-89d0072862ab admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.632247 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a1109-dc63-4352-8eef-89d0072862ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.632438 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a1109-dc63-4352-8eef-89d0072862ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.633560 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a1109-dc63-4352-8eef-89d0072862ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.635167 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a1109-dc63-4352-8eef-89d0072862ab admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.649869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1384/2725] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:09.654186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ba31-4923-445e-9fa9-42bd282fc185 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.665725 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ba31-4923-445e-9fa9-42bd282fc185 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.670847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a5364-db92-4f13-bed9-c8873c9e5a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.671835 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a5364-db92-4f13-bed9-c8873c9e5a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.672121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a5364-db92-4f13-bed9-c8873c9e5a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.672396 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a5364-db92-4f13-bed9-c8873c9e5a87 admin admin] PATH_INFO: `/v3/projects/8e8a1f826c274ce4b34362dae89567d3/users/0572c66f3c7f4acabffdb247dcb945b9/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.695505 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a5364-db92-4f13-bed9-c8873c9e5a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8a1f826c274ce4b34362dae89567d3, user_id=0572c66f3c7f4acabffdb247dcb945b9, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.700112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a5364-db92-4f13-bed9-c8873c9e5a87 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.719466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1342/2726] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:09 2022] PUT /identity/v3/projects/8e8a1f826c274ce4b34362dae89567d3/users/0572c66f3c7f4acabffdb247dcb945b9/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:09.731007 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8793115-19d2-4529-89d7-0c18b14e985b None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.732439 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8793115-19d2-4529-89d7-0c18b14e985b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.732912 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8793115-19d2-4529-89d7-0c18b14e985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.755785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-d8793115-19d2-4529-89d7-0c18b14e985b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:09.757134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d8793115-19d2-4529-89d7-0c18b14e985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:09.836807 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1385/2727] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:09.843594 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a5364-db92-4f13-bed9-c8873c9e5a87 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:09.845370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c36a5364-db92-4f13-bed9-c8873c9e5a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:09.908995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a5364-db92-4f13-bed9-c8873c9e5a87 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:09.913431 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ca95a-97cf-4d69-8920-d93feeb3b9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:09.914118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ca95a-97cf-4d69-8920-d93feeb3b9bb service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:09.914455 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ca95a-97cf-4d69-8920-d93feeb3b9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:09.914735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ca95a-97cf-4d69-8920-d93feeb3b9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:09.924834 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ca95a-97cf-4d69-8920-d93feeb3b9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:09.926300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ca95a-97cf-4d69-8920-d93feeb3b9bb service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:09.938324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1343/2728] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:12.011614 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8793115-19d2-4529-89d7-0c18b14e985b None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:12.028299 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-d8793115-19d2-4529-89d7-0c18b14e985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:12.127540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ca95a-97cf-4d69-8920-d93feeb3b9bb service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:12.129754 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-de4ca95a-97cf-4d69-8920-d93feeb3b9bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:12.150941 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ca95a-97cf-4d69-8920-d93feeb3b9bb service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:12.172645 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8793115-19d2-4529-89d7-0c18b14e985b None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:12.177292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:12.179265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.179835 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.181025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] PATH_INFO: `/v3/users/c4dfdeb737d149d881bc9cbd9116cd6e` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.181616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1541c-a01b-4c34-9ee5-76764a17b0ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:12.182292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1541c-a01b-4c34-9ee5-76764a17b0ca service placement] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.182607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1541c-a01b-4c34-9ee5-76764a17b0ca service placement] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.182885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1541c-a01b-4c34-9ee5-76764a17b0ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.183365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4dfdeb737d149d881bc9cbd9116cd6e)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:12.184816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-cca1541c-a01b-4c34-9ee5-76764a17b0ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:12.186595 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:12.205766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1541c-a01b-4c34-9ee5-76764a17b0ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:12.207827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1541c-a01b-4c34-9ee5-76764a17b0ca service placement] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:12.227536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1386/2729] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:12.277582 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:12.288344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4dfdeb737d149d881bc9cbd9116cd6e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.309074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4dfdeb737d149d881bc9cbd9116cd6e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.310007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4dfdeb737d149d881bc9cbd9116cd6e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.320533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4dfdeb737d149d881bc9cbd9116cd6e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.332444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-d3e85f98-1137-4e70-b21d-e349bf38abb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4dfdeb737d149d881bc9cbd9116cd6e'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.340650 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1344/2730] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:12 2022] DELETE /identity/v3/users/c4dfdeb737d149d881bc9cbd9116cd6e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:12.748715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1541c-a01b-4c34-9ee5-76764a17b0ca service placement] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:12.763763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1541c-a01b-4c34-9ee5-76764a17b0ca service placement] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:12.827514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:12.849525 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:12.850479 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.850767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.851049 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] PATH_INFO: `/v3/projects/ed7d6f19cd7d4ef4b221175972b8db78` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.854678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7d6f19cd7d4ef4b221175972b8db78)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:12.854995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:12.922746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7d6f19cd7d4ef4b221175972b8db78', 'request_id': 'req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.929188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7d6f19cd7d4ef4b221175972b8db78', 'request_id': 'req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.937825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7d6f19cd7d4ef4b221175972b8db78', 'request_id': 'req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.951321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] The token cache is being invalidate because project ed7d6f19cd7d4ef4b221175972b8db78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:12.951704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.952435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-61d43dd8-715a-4b04-b4bc-54f4c6d2268e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:12.958207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1387/2731] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:12 2022] DELETE /identity/v3/projects/ed7d6f19cd7d4ef4b221175972b8db78 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:12.960441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b167e4-1bc4-4b60-8299-099b57b66ac9 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:12.960733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b167e4-1bc4-4b60-8299-099b57b66ac9 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:12.961008 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b167e4-1bc4-4b60-8299-099b57b66ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:12.981096 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-a0b167e4-1bc4-4b60-8299-099b57b66ac9 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:12.982450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-a0b167e4-1bc4-4b60-8299-099b57b66ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.068616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8d2d5-c1c1-4d4e-86a0-5bfc575f2c9a None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.070119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8d2d5-c1c1-4d4e-86a0-5bfc575f2c9a None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.070841 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8d2d5-c1c1-4d4e-86a0-5bfc575f2c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.073651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1345/2732] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:13.091837 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4bb8d2d5-c1c1-4d4e-86a0-5bfc575f2c9a None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:13.093633 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4bb8d2d5-c1c1-4d4e-86a0-5bfc575f2c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.102350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1388/2733] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:13.106355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b167e4-1bc4-4b60-8299-099b57b66ac9 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.118175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b167e4-1bc4-4b60-8299-099b57b66ac9 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.125093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d80e44-d998-4eca-8695-5702a1c5b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.126098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d80e44-d998-4eca-8695-5702a1c5b82f admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.126617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d80e44-d998-4eca-8695-5702a1c5b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.127091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d80e44-d998-4eca-8695-5702a1c5b82f admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.128013 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d80e44-d998-4eca-8695-5702a1c5b82f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 18:57:13.129671 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d80e44-d998-4eca-8695-5702a1c5b82f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.131614 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d80e44-d998-4eca-8695-5702a1c5b82f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.146461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1346/2734] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 18:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 18:57:13.151333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8d2d5-c1c1-4d4e-86a0-5bfc575f2c9a None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.164039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8d2d5-c1c1-4d4e-86a0-5bfc575f2c9a None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.169982 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124d20b-37ee-492b-9b42-77856cecac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.170804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124d20b-37ee-492b-9b42-77856cecac9a admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.171354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124d20b-37ee-492b-9b42-77856cecac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.171497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124d20b-37ee-492b-9b42-77856cecac9a admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.172259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124d20b-37ee-492b-9b42-77856cecac9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.174357 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124d20b-37ee-492b-9b42-77856cecac9a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.221694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1389/2735] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:13 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:13.226607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d80e44-d998-4eca-8695-5702a1c5b82f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.239051 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d80e44-d998-4eca-8695-5702a1c5b82f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.329538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aca13e-8c35-4d56-bfec-11e66d7a1768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.330292 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aca13e-8c35-4d56-bfec-11e66d7a1768 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.330615 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aca13e-8c35-4d56-bfec-11e66d7a1768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.330890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aca13e-8c35-4d56-bfec-11e66d7a1768 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.333783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aca13e-8c35-4d56-bfec-11e66d7a1768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.337542 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aca13e-8c35-4d56-bfec-11e66d7a1768 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.363185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1347/2736] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:13 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 18:57:13.367257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124d20b-37ee-492b-9b42-77856cecac9a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.379980 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124d20b-37ee-492b-9b42-77856cecac9a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.386835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c126-30a8-4614-ba6f-e188caba761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.387636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c126-30a8-4614-ba6f-e188caba761e admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.388384 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c126-30a8-4614-ba6f-e188caba761e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.388384 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c126-30a8-4614-ba6f-e188caba761e admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.389016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c126-30a8-4614-ba6f-e188caba761e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.390642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c126-30a8-4614-ba6f-e188caba761e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.404663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1390/2737] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:13.409116 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aca13e-8c35-4d56-bfec-11e66d7a1768 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.420746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aca13e-8c35-4d56-bfec-11e66d7a1768 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.428657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6c4b4-f618-4539-bdfc-45c313dcb826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.428869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6c4b4-f618-4539-bdfc-45c313dcb826 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.429247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6c4b4-f618-4539-bdfc-45c313dcb826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.429553 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6c4b4-f618-4539-bdfc-45c313dcb826 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.430358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6c4b4-f618-4539-bdfc-45c313dcb826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.432148 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6c4b4-f618-4539-bdfc-45c313dcb826 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.449332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1348/2738] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:13.451297 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c126-30a8-4614-ba6f-e188caba761e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.465427 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c126-30a8-4614-ba6f-e188caba761e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.472267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512757f9-85c4-4a47-b061-3577bf0ce170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.473568 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512757f9-85c4-4a47-b061-3577bf0ce170 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.474022 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512757f9-85c4-4a47-b061-3577bf0ce170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.475845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512757f9-85c4-4a47-b061-3577bf0ce170 admin admin] PATH_INFO: `/v3/projects/8e9e688af9394dfb858df5d221847313/users/a8a681fc81c94248b23d15971e41f6a8/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.497071 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512757f9-85c4-4a47-b061-3577bf0ce170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9e688af9394dfb858df5d221847313, user_id=a8a681fc81c94248b23d15971e41f6a8, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.499966 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512757f9-85c4-4a47-b061-3577bf0ce170 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.522431 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1391/2739] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:13 2022] PUT /identity/v3/projects/8e9e688af9394dfb858df5d221847313/users/a8a681fc81c94248b23d15971e41f6a8/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:13.524320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cef659-f5cd-49c0-8637-6381f6e20c2f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.524611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cef659-f5cd-49c0-8637-6381f6e20c2f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.524891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cef659-f5cd-49c0-8637-6381f6e20c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.551718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d0cef659-f5cd-49c0-8637-6381f6e20c2f None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:13.552973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d0cef659-f5cd-49c0-8637-6381f6e20c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.572747 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:13.628776 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1349/2740] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:13.638678 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512757f9-85c4-4a47-b061-3577bf0ce170 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:13.641986 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-512757f9-85c4-4a47-b061-3577bf0ce170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:13.712868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512757f9-85c4-4a47-b061-3577bf0ce170 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:13.719014 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000f96e-f4ad-4152-bfe6-d3feeb320b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:13.720030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000f96e-f4ad-4152-bfe6-d3feeb320b41 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:13.720321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000f96e-f4ad-4152-bfe6-d3feeb320b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:13.720601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000f96e-f4ad-4152-bfe6-d3feeb320b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:13.739421 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000f96e-f4ad-4152-bfe6-d3feeb320b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:13.748834 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000f96e-f4ad-4152-bfe6-d3feeb320b41 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:13.767896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1392/2741] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:15.075080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961de854-1f13-48e6-9d9e-8fb477383b96 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.076010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961de854-1f13-48e6-9d9e-8fb477383b96 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.076454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961de854-1f13-48e6-9d9e-8fb477383b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.108097 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-961de854-1f13-48e6-9d9e-8fb477383b96 None None] MFA Rules not processed for user `0572c66f3c7f4acabffdb247dcb945b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:15.109497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-961de854-1f13-48e6-9d9e-8fb477383b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:15.192910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000f96e-f4ad-4152-bfe6-d3feeb320b41 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:15.194263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1350/2742] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:15.195001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-7000f96e-f4ad-4152-bfe6-d3feeb320b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:15.208115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000f96e-f4ad-4152-bfe6-d3feeb320b41 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.213114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adb6b0-1c79-49dd-97de-ca583221ba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.213704 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adb6b0-1c79-49dd-97de-ca583221ba59 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.213985 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adb6b0-1c79-49dd-97de-ca583221ba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.214259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adb6b0-1c79-49dd-97de-ca583221ba59 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.215001 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adb6b0-1c79-49dd-97de-ca583221ba59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:15.217521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adb6b0-1c79-49dd-97de-ca583221ba59 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:15.222254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:15.254184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961de854-1f13-48e6-9d9e-8fb477383b96 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:15.256797 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1393/2743] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 18:57:15 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:15.266585 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961de854-1f13-48e6-9d9e-8fb477383b96 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.354493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bba86-49d5-47a0-bd55-9e76ddfeae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.355016 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bba86-49d5-47a0-bd55-9e76ddfeae82 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.355324 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bba86-49d5-47a0-bd55-9e76ddfeae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.355651 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bba86-49d5-47a0-bd55-9e76ddfeae82 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.356641 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bba86-49d5-47a0-bd55-9e76ddfeae82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:15.358578 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bba86-49d5-47a0-bd55-9e76ddfeae82 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:15.387432 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1351/2744] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 18:57:15 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 18:57:15.391181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adb6b0-1c79-49dd-97de-ca583221ba59 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:15.406626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adb6b0-1c79-49dd-97de-ca583221ba59 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.413571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ab835-1e4b-406e-8ff5-e57a288ad071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.414635 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ab835-1e4b-406e-8ff5-e57a288ad071 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.415276 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ab835-1e4b-406e-8ff5-e57a288ad071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.415627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ab835-1e4b-406e-8ff5-e57a288ad071 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.416498 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ab835-1e4b-406e-8ff5-e57a288ad071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:15.418343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ab835-1e4b-406e-8ff5-e57a288ad071 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:15.435298 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1394/2745] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:15.442237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bba86-49d5-47a0-bd55-9e76ddfeae82 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:15.456174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bba86-49d5-47a0-bd55-9e76ddfeae82 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.464766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d3415-ba50-4eae-a601-1c6b6bbc271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.466121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d3415-ba50-4eae-a601-1c6b6bbc271f admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.466273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d3415-ba50-4eae-a601-1c6b6bbc271f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.466682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d3415-ba50-4eae-a601-1c6b6bbc271f admin admin] PATH_INFO: `/v3/projects/365119787ca4449a925dbb877de25701/users/3cd0e8dee6eb44b2957c78c7c3d273ae/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.485390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d3415-ba50-4eae-a601-1c6b6bbc271f admin admin] RBAC: Authorizing `identity:create_grant(project_id=365119787ca4449a925dbb877de25701, user_id=3cd0e8dee6eb44b2957c78c7c3d273ae, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:15.488496 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d3415-ba50-4eae-a601-1c6b6bbc271f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:15.524903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1352/2746] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:15 2022] PUT /identity/v3/projects/365119787ca4449a925dbb877de25701/users/3cd0e8dee6eb44b2957c78c7c3d273ae/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:15.530414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ab835-1e4b-406e-8ff5-e57a288ad071 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:15.556668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ab835-1e4b-406e-8ff5-e57a288ad071 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.665371 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0858d16-f48c-4791-b178-24d1dd22b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.666112 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858d16-f48c-4791-b178-24d1dd22b07b admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.666480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858d16-f48c-4791-b178-24d1dd22b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.667168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858d16-f48c-4791-b178-24d1dd22b07b admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.667885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0858d16-f48c-4791-b178-24d1dd22b07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:15.670451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0858d16-f48c-4791-b178-24d1dd22b07b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:15.686435 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1395/2747] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 18:57:15.690218 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d3415-ba50-4eae-a601-1c6b6bbc271f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:15.701518 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d3415-ba50-4eae-a601-1c6b6bbc271f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:15.706663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025ffa5-97b7-42ee-bab4-2ba35080e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:15.707938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025ffa5-97b7-42ee-bab4-2ba35080e7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:15.708622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025ffa5-97b7-42ee-bab4-2ba35080e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:15.709058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025ffa5-97b7-42ee-bab4-2ba35080e7bf admin admin] PATH_INFO: `/v3/projects/365119787ca4449a925dbb877de25701/users/3cd0e8dee6eb44b2957c78c7c3d273ae/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:15.711498 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025ffa5-97b7-42ee-bab4-2ba35080e7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=365119787ca4449a925dbb877de25701, user_id=3cd0e8dee6eb44b2957c78c7c3d273ae, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:15.715890 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025ffa5-97b7-42ee-bab4-2ba35080e7bf admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:15.731429 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1353/2748] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 18:57:15 2022] PUT /identity/v3/projects/365119787ca4449a925dbb877de25701/users/3cd0e8dee6eb44b2957c78c7c3d273ae/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:20.544506 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0ed52-615b-4f76-918e-3a7be227a7a4 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:20.544971 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0ed52-615b-4f76-918e-3a7be227a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:20.545258 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0ed52-615b-4f76-918e-3a7be227a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:20.605529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-dab0ed52-615b-4f76-918e-3a7be227a7a4 None None] MFA Rules not processed for user `a8a681fc81c94248b23d15971e41f6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:20.607020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dab0ed52-615b-4f76-918e-3a7be227a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:20.776818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1396/2749] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:20.783940 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025ffa5-97b7-42ee-bab4-2ba35080e7bf admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:20.785939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8025ffa5-97b7-42ee-bab4-2ba35080e7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:20.795348 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:20.935936 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025ffa5-97b7-42ee-bab4-2ba35080e7bf admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:20.944583 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f03d3c-2ecb-4699-9d66-438f39d7d2d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:20.946616 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f03d3c-2ecb-4699-9d66-438f39d7d2d6 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:20.946931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f03d3c-2ecb-4699-9d66-438f39d7d2d6 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:20.947353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f03d3c-2ecb-4699-9d66-438f39d7d2d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:20.960492 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f03d3c-2ecb-4699-9d66-438f39d7d2d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:20.962540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f03d3c-2ecb-4699-9d66-438f39d7d2d6 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:20.975635 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1354/2750] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:23.008187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e1616-e863-4a17-910f-c4f4d3ea1a3c None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:23.009013 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e1616-e863-4a17-910f-c4f4d3ea1a3c None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:23.009460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e1616-e863-4a17-910f-c4f4d3ea1a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:23.077126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-793e1616-e863-4a17-910f-c4f4d3ea1a3c None None] MFA Rules not processed for user `3cd0e8dee6eb44b2957c78c7c3d273ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:23.079090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-793e1616-e863-4a17-910f-c4f4d3ea1a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:23.113721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a575a-0a91-4652-9fcc-11c8cc0e5680 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:23.114207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a575a-0a91-4652-9fcc-11c8cc0e5680 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:23.114602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a575a-0a91-4652-9fcc-11c8cc0e5680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:23.137581 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-062a575a-0a91-4652-9fcc-11c8cc0e5680 None None] MFA Rules not processed for user `a8a681fc81c94248b23d15971e41f6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:23.138972 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-062a575a-0a91-4652-9fcc-11c8cc0e5680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:23.144647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:23.149341 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1355/2751] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:23.186142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1397/2752] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:23.195786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a575a-0a91-4652-9fcc-11c8cc0e5680 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:23.197683 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-062a575a-0a91-4652-9fcc-11c8cc0e5680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:23.307642 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a575a-0a91-4652-9fcc-11c8cc0e5680 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:23.312082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aa8ac-4a6c-43a0-9e13-e42a679376f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beb359ac9b084b38b77923219f42f655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:23.313117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aa8ac-4a6c-43a0-9e13-e42a679376f6 service glance] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:23.313750 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aa8ac-4a6c-43a0-9e13-e42a679376f6 service glance] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:23.314100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aa8ac-4a6c-43a0-9e13-e42a679376f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:23.426405 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0aa8ac-4a6c-43a0-9e13-e42a679376f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:23.428565 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0aa8ac-4a6c-43a0-9e13-e42a679376f6 service glance] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:23.451871 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1356/2753] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:23.577546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444487a-1225-4427-a68d-72a8e3f6be77 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:23.577851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444487a-1225-4427-a68d-72a8e3f6be77 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:23.578131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444487a-1225-4427-a68d-72a8e3f6be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:23.610928 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3444487a-1225-4427-a68d-72a8e3f6be77 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:23.612617 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3444487a-1225-4427-a68d-72a8e3f6be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:23.655577 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aa8ac-4a6c-43a0-9e13-e42a679376f6 service glance] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:23.722000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=100 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:23.743030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aa8ac-4a6c-43a0-9e13-e42a679376f6 service glance] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:23.749132 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4fdd3-5384-4379-99a7-c813501af56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:23.749924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4fdd3-5384-4379-99a7-c813501af56c service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:23.750211 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4fdd3-5384-4379-99a7-c813501af56c service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:23.750699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4fdd3-5384-4379-99a7-c813501af56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:23.758426 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-37e4fdd3-5384-4379-99a7-c813501af56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:23.760216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1398/2754] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:23.772808 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4fdd3-5384-4379-99a7-c813501af56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:23.774757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4fdd3-5384-4379-99a7-c813501af56c service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:23.786408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1357/2755] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:23.818932 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444487a-1225-4427-a68d-72a8e3f6be77 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:23.821598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3444487a-1225-4427-a68d-72a8e3f6be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:23.915960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444487a-1225-4427-a68d-72a8e3f6be77 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:23.922064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a146-c6ec-49a6-bccf-c13373b7c64e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:23.922868 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a146-c6ec-49a6-bccf-c13373b7c64e service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:23.923237 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a146-c6ec-49a6-bccf-c13373b7c64e service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:23.923575 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a146-c6ec-49a6-bccf-c13373b7c64e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:23.936871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8a146-c6ec-49a6-bccf-c13373b7c64e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:23.937903 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8a146-c6ec-49a6-bccf-c13373b7c64e service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:23.949127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1399/2756] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:57:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:33.781045 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=9 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:33.944926 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=63 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:34.924421 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7dd3f-e6db-469f-bb87-dabd7fc6372f None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:34.924930 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7dd3f-e6db-469f-bb87-dabd7fc6372f None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:34.925029 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7dd3f-e6db-469f-bb87-dabd7fc6372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:34.942922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2cb7dd3f-e6db-469f-bb87-dabd7fc6372f None None] MFA Rules not processed for user `0572c66f3c7f4acabffdb247dcb945b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:34.944331 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2cb7dd3f-e6db-469f-bb87-dabd7fc6372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:34.952277 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1358/2757] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:57:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:35.279267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a146-c6ec-49a6-bccf-c13373b7c64e service swift] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:35.289006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a146-c6ec-49a6-bccf-c13373b7c64e service swift] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:35.292583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b9654-9937-428d-89b2-953cb61d10fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:35.293194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b9654-9937-428d-89b2-953cb61d10fd service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:35.296584 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b9654-9937-428d-89b2-953cb61d10fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:35.297854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b9654-9937-428d-89b2-953cb61d10fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:35.299769 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-dc3b9654-9937-428d-89b2-953cb61d10fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:35.310142 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b9654-9937-428d-89b2-953cb61d10fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:35.311642 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b9654-9937-428d-89b2-953cb61d10fd service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:35.320992 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1400/2758] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:36.941848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496906db-7432-4ef6-be23-985af10e8383 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:36.943159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496906db-7432-4ef6-be23-985af10e8383 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:36.943794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496906db-7432-4ef6-be23-985af10e8383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:36.968441 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-496906db-7432-4ef6-be23-985af10e8383 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:57:36.970005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-496906db-7432-4ef6-be23-985af10e8383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:36.981528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1359/2759] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 18:57:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:57:36.996626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b9654-9937-428d-89b2-953cb61d10fd service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:37.017521 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b9654-9937-428d-89b2-953cb61d10fd service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:37.027004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0994c-2a1a-40e2-99a9-a3789ee2da9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:37.028239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0994c-2a1a-40e2-99a9-a3789ee2da9c service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:37.028711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0994c-2a1a-40e2-99a9-a3789ee2da9c service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:37.029164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0994c-2a1a-40e2-99a9-a3789ee2da9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:37.061186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0994c-2a1a-40e2-99a9-a3789ee2da9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:37.064943 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0994c-2a1a-40e2-99a9-a3789ee2da9c service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:37.080840 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1401/2760] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 18:57:40.944803 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496906db-7432-4ef6-be23-985af10e8383 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:40.946828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-496906db-7432-4ef6-be23-985af10e8383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:40.967040 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496906db-7432-4ef6-be23-985af10e8383 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:41.009118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:41.009782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:41.010060 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:41.010332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:41.012206 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:41.036746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:41.039444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:41.072050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1360/2761] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:41.128453 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0994c-2a1a-40e2-99a9-a3789ee2da9c service swift] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:41.155536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0994c-2a1a-40e2-99a9-a3789ee2da9c service swift] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:41.162916 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:41.163721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:41.165052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:41.165052 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:41.170729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:41.256513 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:41.258119 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:41.268535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1402/2762] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:49.802721 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:49.804827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:49.816124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cc7ce-6fd8-42a5-a659-bed4776e2bd5 service nova] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:49.820304 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:49.820929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:49.821206 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:49.821476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:49.823203 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:49.884344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:49.885791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:49.895533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1361/2763] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 18:57:51.263588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=40 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:53.095464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:53.096960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:53.182082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093740-29e3-4846-9a1e-8f45ffd3a7f0 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:53.187518 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e148f-b612-4a54-b91f-a6a1bd0b5a95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:53.188191 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e148f-b612-4a54-b91f-a6a1bd0b5a95 service placement] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:53.188474 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e148f-b612-4a54-b91f-a6a1bd0b5a95 service placement] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:53.188748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e148f-b612-4a54-b91f-a6a1bd0b5a95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:53.190544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-722e148f-b612-4a54-b91f-a6a1bd0b5a95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:53.203436 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e148f-b612-4a54-b91f-a6a1bd0b5a95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:53.205042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e148f-b612-4a54-b91f-a6a1bd0b5a95 service placement] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:53.216005 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1403/2764] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:57:56.608336 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.610430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:56.627541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4a926-ee71-4358-925c-691d3f5fd052 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.632689 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.633522 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.633807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.634082 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] PATH_INFO: `/v3/users/0a5776b5796044f4b8db3b7ffac5940c` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.635343 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5776b5796044f4b8db3b7ffac5940c)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.637257 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:56.685731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5776b5796044f4b8db3b7ffac5940c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.699099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5776b5796044f4b8db3b7ffac5940c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.699806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5776b5796044f4b8db3b7ffac5940c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.706706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5776b5796044f4b8db3b7ffac5940c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.722437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5776b5796044f4b8db3b7ffac5940c'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:56.722437 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1362/2765] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:56 2022] DELETE /identity/v3/users/0a5776b5796044f4b8db3b7ffac5940c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:56.909347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e148f-b612-4a54-b91f-a6a1bd0b5a95 service placement] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:56.928133 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e148f-b612-4a54-b91f-a6a1bd0b5a95 service placement] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:56.990893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:56.991785 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:56.992069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:56.992348 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] PATH_INFO: `/v3/projects/0fc0e45eab5d4989b92f4b2933b5df24` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:56.993663 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc0e45eab5d4989b92f4b2933b5df24)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:56.995756 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.049114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc0e45eab5d4989b92f4b2933b5df24', 'request_id': 'req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.056009 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc0e45eab5d4989b92f4b2933b5df24', 'request_id': 'req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.071748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc0e45eab5d4989b92f4b2933b5df24', 'request_id': 'req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.085372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] The token cache is being invalidate because project 0fc0e45eab5d4989b92f4b2933b5df24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:57.085709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.086839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.088777 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1404/2766] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:56 2022] DELETE /identity/v3/projects/0fc0e45eab5d4989b92f4b2933b5df24 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:57.092862 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.094321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:57.112536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5a1b0-8873-4980-a643-332c714ce991 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.152205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:57.176417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.178085 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.178640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.179164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] PATH_INFO: `/v3/users/e0b1f9a9abdd485d9393dfe556d0f502` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.181369 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b1f9a9abdd485d9393dfe556d0f502)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:57.184878 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.233452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b1f9a9abdd485d9393dfe556d0f502'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.247407 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b1f9a9abdd485d9393dfe556d0f502'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.248185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b1f9a9abdd485d9393dfe556d0f502'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.255544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b1f9a9abdd485d9393dfe556d0f502'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.262922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b1f9a9abdd485d9393dfe556d0f502'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.270353 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1363/2767] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:57:57 2022] DELETE /identity/v3/users/e0b1f9a9abdd485d9393dfe556d0f502 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:57:57.445312 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:57.447531 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:57.462104 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ec1de-bd34-4afb-8c2b-57f9428a927f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:57.480748 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:57.529495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:57.530373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:57.530667 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:57.530938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] PATH_INFO: `/v3/projects/02d842387a9b49808caf11c84c1763b0` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:57.532403 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d842387a9b49808caf11c84c1763b0)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:57.534288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:57.582171 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d842387a9b49808caf11c84c1763b0', 'request_id': 'req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.588367 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d842387a9b49808caf11c84c1763b0', 'request_id': 'req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.596759 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d842387a9b49808caf11c84c1763b0', 'request_id': 'req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.611559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] The token cache is being invalidate because project 02d842387a9b49808caf11c84c1763b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:57:57.611847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.612507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a33582de-d5ea-45b9-94e6-3c6f8f36bcbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:57:57.614900 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1405/2768] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:57:57 2022] DELETE /identity/v3/projects/02d842387a9b49808caf11c84c1763b0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:57:58.398763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:57:58.400270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:58.459337 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317e042-d0f1-4ae8-b5c4-1417a5725836 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:57:58.507344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:57:58.507925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:57:58.508213 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:57:58.508484 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:57:58.510370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:57:58.541178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:58.575102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:57:58.576537 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:57:58.588164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1364/2769] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:57:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:58:07.607193 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:08.584217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=16 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:17.314197 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a361203-f20c-4eb9-b02e-5b292e879b49 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:58:17.314764 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a361203-f20c-4eb9-b02e-5b292e879b49 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:58:17.314879 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a361203-f20c-4eb9-b02e-5b292e879b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:58:17.333422 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-5a361203-f20c-4eb9-b02e-5b292e879b49 None None] MFA Rules not processed for user `a8a681fc81c94248b23d15971e41f6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:58:17.334662 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5a361203-f20c-4eb9-b02e-5b292e879b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:58:17.393865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1406/2770] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:58:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:58:27.386752 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=25 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:08.610851 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:08.612473 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:08.697826 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65342-edf5-4a2d-aa73-283958110c8e service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:08.703434 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957b71-860d-4631-8e80-f353fdd5b2ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:08.704733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957b71-860d-4631-8e80-f353fdd5b2ea service placement] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:08.704733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957b71-860d-4631-8e80-f353fdd5b2ea service placement] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:08.704733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957b71-860d-4631-8e80-f353fdd5b2ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:08.706733 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d4957b71-860d-4631-8e80-f353fdd5b2ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:08.718935 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957b71-860d-4631-8e80-f353fdd5b2ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:08.720631 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957b71-860d-4631-8e80-f353fdd5b2ea service placement] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:08.731424 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1365/2771] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 18:59:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 18:59:17.567268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bc96e-13c4-46bb-b896-22693bc5cc76 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:17.567935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bc96e-13c4-46bb-b896-22693bc5cc76 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:17.567935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bc96e-13c4-46bb-b896-22693bc5cc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:17.591823 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-4b8bc96e-13c4-46bb-b896-22693bc5cc76 None None] MFA Rules not processed for user `a8a681fc81c94248b23d15971e41f6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:17.593090 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4b8bc96e-13c4-46bb-b896-22693bc5cc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:17.600478 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1407/2772] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 18:59:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:18.726931 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=32 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:27.585694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:28.694322 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79196ad-c9b1-4c5a-87f6-930313b0c1e1 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.695197 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79196ad-c9b1-4c5a-87f6-930313b0c1e1 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.695367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79196ad-c9b1-4c5a-87f6-930313b0c1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.716372 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-b79196ad-c9b1-4c5a-87f6-930313b0c1e1 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 18:59:28.717716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b79196ad-c9b1-4c5a-87f6-930313b0c1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.786731 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1366/2773] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jun 16 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 18:59:28.831507 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bc96e-13c4-46bb-b896-22693bc5cc76 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:28.833035 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-4b8bc96e-13c4-46bb-b896-22693bc5cc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:28.911163 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bc96e-13c4-46bb-b896-22693bc5cc76 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:28.916592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3de60-9327-4552-b03a-01d6eb3d771c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:28.917321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3de60-9327-4552-b03a-01d6eb3d771c service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:28.917644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3de60-9327-4552-b03a-01d6eb3d771c service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:28.917962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3de60-9327-4552-b03a-01d6eb3d771c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:28.929100 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3de60-9327-4552-b03a-01d6eb3d771c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:28.931270 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3de60-9327-4552-b03a-01d6eb3d771c service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:28.942089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1408/2774] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 18:59:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 18:59:38.780207 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=25 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:38.938095 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=32 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:39.654041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79196ad-c9b1-4c5a-87f6-930313b0c1e1 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:39.656525 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b79196ad-c9b1-4c5a-87f6-930313b0c1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:39.751186 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79196ad-c9b1-4c5a-87f6-930313b0c1e1 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:39.757237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:39.758411 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:39.758802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:39.759093 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] PATH_INFO: `/v3/users/0572c66f3c7f4acabffdb247dcb945b9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:39.760605 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0572c66f3c7f4acabffdb247dcb945b9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:39.762654 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:39.823907 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0572c66f3c7f4acabffdb247dcb945b9'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:39.841509 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0572c66f3c7f4acabffdb247dcb945b9'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:39.842326 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0572c66f3c7f4acabffdb247dcb945b9'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:39.851911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0572c66f3c7f4acabffdb247dcb945b9'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:39.861062 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0572c66f3c7f4acabffdb247dcb945b9'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:39.868718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1367/2775] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:39 2022] DELETE /identity/v3/users/0572c66f3c7f4acabffdb247dcb945b9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:40.081924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3de60-9327-4552-b03a-01d6eb3d771c service swift] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:40.102147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3de60-9327-4552-b03a-01d6eb3d771c service swift] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:40.180470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:40.182038 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:40.182566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:40.183016 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] PATH_INFO: `/v3/projects/8e8a1f826c274ce4b34362dae89567d3` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:40.184570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8a1f826c274ce4b34362dae89567d3)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:40.186830 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:40.245429 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8a1f826c274ce4b34362dae89567d3', 'request_id': 'req-44123e22-a43a-4386-a108-4de954567b6a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.252940 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8a1f826c274ce4b34362dae89567d3', 'request_id': 'req-44123e22-a43a-4386-a108-4de954567b6a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.262207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8a1f826c274ce4b34362dae89567d3', 'request_id': 'req-44123e22-a43a-4386-a108-4de954567b6a'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.276130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] The token cache is being invalidate because project 8e8a1f826c274ce4b34362dae89567d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:40.276495 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.277229 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.279463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1409/2776] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:40 2022] DELETE /identity/v3/projects/8e8a1f826c274ce4b34362dae89567d3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:40.284588 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:40.286284 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:40.301704 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21abfa4-3290-47c7-8ea8-8f4e4a730187 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:40.371945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:40.372743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:40.373556 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:40.373839 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] PATH_INFO: `/v3/users/3cd0e8dee6eb44b2957c78c7c3d273ae` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:40.375230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd0e8dee6eb44b2957c78c7c3d273ae)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:40.377200 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:40.403716 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:40.437570 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd0e8dee6eb44b2957c78c7c3d273ae'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.453450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd0e8dee6eb44b2957c78c7c3d273ae'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.454854 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd0e8dee6eb44b2957c78c7c3d273ae'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.468746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd0e8dee6eb44b2957c78c7c3d273ae'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.482044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5234225d-307d-4c86-bfbf-eb9c84226928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd0e8dee6eb44b2957c78c7c3d273ae'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.491669 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1368/2777] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 18:59:40 2022] DELETE /identity/v3/users/3cd0e8dee6eb44b2957c78c7c3d273ae => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 18:59:40.721025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 18:59:40.722843 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 18:59:40.745720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123e22-a43a-4386-a108-4de954567b6a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 18:59:40.825441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 18:59:40.826881 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 18:59:40.827179 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 18:59:40.827448 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] PATH_INFO: `/v3/projects/365119787ca4449a925dbb877de25701` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 18:59:40.828753 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365119787ca4449a925dbb877de25701)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 18:59:40.830773 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 18:59:40.873552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:40.892812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365119787ca4449a925dbb877de25701', 'request_id': 'req-a1b39e87-ae95-4cd7-9920-b48076db2199'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.900774 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365119787ca4449a925dbb877de25701', 'request_id': 'req-a1b39e87-ae95-4cd7-9920-b48076db2199'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.914675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365119787ca4449a925dbb877de25701', 'request_id': 'req-a1b39e87-ae95-4cd7-9920-b48076db2199'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.934618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] The token cache is being invalidate because project 365119787ca4449a925dbb877de25701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 18:59:40.935122 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.936259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 18:59:40.939061 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1410/2778] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 18:59:40 2022] DELETE /identity/v3/projects/365119787ca4449a925dbb877de25701 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 18:59:50.486576 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:50.928463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:11.774988 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8f422-a427-495d-a50d-b674a2003cfc None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:11.777263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8f422-a427-495d-a50d-b674a2003cfc None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:11.777263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8f422-a427-495d-a50d-b674a2003cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:11.797719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-40e8f422-a427-495d-a50d-b674a2003cfc None None] MFA Rules not processed for user `a8a681fc81c94248b23d15971e41f6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:00:11.799131 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-40e8f422-a427-495d-a50d-b674a2003cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:11.861639 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1369/2779] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:00:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:00:18.541935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:18.543896 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:18.613727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b39e87-ae95-4cd7-9920-b48076db2199 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:18.617944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:18.618676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:18.618953 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:18.619222 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:18.621727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:18.712587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:18.714181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:18.728338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1411/2780] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:00:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:00:21.852144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=25 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:24.925276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8f422-a427-495d-a50d-b674a2003cfc None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:00:24.937756 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8f422-a427-495d-a50d-b674a2003cfc None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:00:24.942347 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:00:24.943185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:00:24.943613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:00:24.944099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:00:24.947557 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:00:24.977315 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:00:24.979261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:00:24.995504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1370/2781] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:00:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:00:28.722470 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=54 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:34.988068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=6 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:03.013869 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:03.020503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:03.049861 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91288de8-9722-4042-9766-526ecc5b1687 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:03.063239 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262176a-52c5-4586-a8b6-78e9dffdfda3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:03.064529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262176a-52c5-4586-a8b6-78e9dffdfda3 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:03.065045 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262176a-52c5-4586-a8b6-78e9dffdfda3 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:03.065536 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262176a-52c5-4586-a8b6-78e9dffdfda3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:03.069032 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-1262176a-52c5-4586-a8b6-78e9dffdfda3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:03.098020 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262176a-52c5-4586-a8b6-78e9dffdfda3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:03.101958 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262176a-52c5-4586-a8b6-78e9dffdfda3 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:03.125750 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1412/2782] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:12.623003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:12.625174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:12.711855 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f2cc-bea3-4e16-8aeb-5303c6e2bbd8 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:12.716674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:12.717619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:12.717914 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:12.718175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] PATH_INFO: `/v3/users/a8a681fc81c94248b23d15971e41f6a8` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:12.719526 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a681fc81c94248b23d15971e41f6a8)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:12.721472 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:12.784104 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a681fc81c94248b23d15971e41f6a8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:12.797448 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a681fc81c94248b23d15971e41f6a8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:12.798266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a681fc81c94248b23d15971e41f6a8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:12.806157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a681fc81c94248b23d15971e41f6a8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:12.815529 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-83c34b4a-79d2-45c4-8e0e-dcc5dff0a542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a681fc81c94248b23d15971e41f6a8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:12.822711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1371/2783] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:12 2022] DELETE /identity/v3/users/a8a681fc81c94248b23d15971e41f6a8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:13.012607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262176a-52c5-4586-a8b6-78e9dffdfda3 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:13.025288 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262176a-52c5-4586-a8b6-78e9dffdfda3 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:13.091587 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:13.092458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.092743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.093021 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] PATH_INFO: `/v3/projects/8e9e688af9394dfb858df5d221847313` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.094226 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9e688af9394dfb858df5d221847313)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:13.096444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:13.152185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9e688af9394dfb858df5d221847313', 'request_id': 'req-578e480f-a9ae-4445-83af-d121e302a493'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:13.159486 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9e688af9394dfb858df5d221847313', 'request_id': 'req-578e480f-a9ae-4445-83af-d121e302a493'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:13.169583 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9e688af9394dfb858df5d221847313', 'request_id': 'req-578e480f-a9ae-4445-83af-d121e302a493'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:13.184512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] The token cache is being invalidate because project 8e9e688af9394dfb858df5d221847313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:13.184972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:13.185801 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-578e480f-a9ae-4445-83af-d121e302a493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:13.187761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1413/2784] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:13 2022] DELETE /identity/v3/projects/8e9e688af9394dfb858df5d221847313 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:13.193640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2797db-5e51-4aa8-a1dd-d25fa4d26820 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.193949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2797db-5e51-4aa8-a1dd-d25fa4d26820 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.194237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2797db-5e51-4aa8-a1dd-d25fa4d26820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.215022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-8b2797db-5e51-4aa8-a1dd-d25fa4d26820 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:13.216338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-8b2797db-5e51-4aa8-a1dd-d25fa4d26820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:13.293027 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1372/2785] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:13.301017 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0a2cf-c345-4f6e-944a-410b86633bfc None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.301313 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0a2cf-c345-4f6e-944a-410b86633bfc None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.301839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0a2cf-c345-4f6e-944a-410b86633bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.322709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-2de0a2cf-c345-4f6e-944a-410b86633bfc None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:13.323981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2de0a2cf-c345-4f6e-944a-410b86633bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:13.332383 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1414/2786] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:13.337482 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2797db-5e51-4aa8-a1dd-d25fa4d26820 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:13.347615 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2797db-5e51-4aa8-a1dd-d25fa4d26820 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:13.353245 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549088-3ac9-4bc2-9c0a-7c0c0bc91f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:13.353952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549088-3ac9-4bc2-9c0a-7c0c0bc91f16 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.354248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549088-3ac9-4bc2-9c0a-7c0c0bc91f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.354551 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549088-3ac9-4bc2-9c0a-7c0c0bc91f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.355308 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549088-3ac9-4bc2-9c0a-7c0c0bc91f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:01:13.355626 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549088-3ac9-4bc2-9c0a-7c0c0bc91f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:13.357349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549088-3ac9-4bc2-9c0a-7c0c0bc91f16 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:13.370791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1373/2787] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 19:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:01:13.376025 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0a2cf-c345-4f6e-944a-410b86633bfc None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:13.392818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0a2cf-c345-4f6e-944a-410b86633bfc None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:13.398198 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6888da-f5b7-49e3-8734-c624dd77bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:13.399175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6888da-f5b7-49e3-8734-c624dd77bd76 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.399483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6888da-f5b7-49e3-8734-c624dd77bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.399763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6888da-f5b7-49e3-8734-c624dd77bd76 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.400461 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6888da-f5b7-49e3-8734-c624dd77bd76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:13.402445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6888da-f5b7-49e3-8734-c624dd77bd76 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:13.431340 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1415/2788] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:13 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:13.435945 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549088-3ac9-4bc2-9c0a-7c0c0bc91f16 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:13.453676 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549088-3ac9-4bc2-9c0a-7c0c0bc91f16 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:13.457847 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:13.533007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d38be-0d51-41e4-8910-cd246fde05f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:13.533708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d38be-0d51-41e4-8910-cd246fde05f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.533995 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d38be-0d51-41e4-8910-cd246fde05f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.534273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d38be-0d51-41e4-8910-cd246fde05f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.535290 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d38be-0d51-41e4-8910-cd246fde05f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:13.537625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d38be-0d51-41e4-8910-cd246fde05f0 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:13.568390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1374/2789] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:13 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:13.573825 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6888da-f5b7-49e3-8734-c624dd77bd76 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:13.587989 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6888da-f5b7-49e3-8734-c624dd77bd76 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:13.596847 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914427-43c2-4bef-a108-967864afe9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:13.597744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914427-43c2-4bef-a108-967864afe9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.598105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914427-43c2-4bef-a108-967864afe9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.598546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914427-43c2-4bef-a108-967864afe9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.599373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac914427-43c2-4bef-a108-967864afe9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:13.601515 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac914427-43c2-4bef-a108-967864afe9f7 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:13.620500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1416/2790] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:13.624903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d38be-0d51-41e4-8910-cd246fde05f0 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:13.636613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d38be-0d51-41e4-8910-cd246fde05f0 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:13.641997 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703d40f-fd6f-4b15-b4d7-f4b77dc91fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:13.642769 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703d40f-fd6f-4b15-b4d7-f4b77dc91fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.643055 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703d40f-fd6f-4b15-b4d7-f4b77dc91fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.643350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703d40f-fd6f-4b15-b4d7-f4b77dc91fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.644121 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703d40f-fd6f-4b15-b4d7-f4b77dc91fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:13.645811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703d40f-fd6f-4b15-b4d7-f4b77dc91fe1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:13.657247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1375/2791] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:13.663487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914427-43c2-4bef-a108-967864afe9f7 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:13.677588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914427-43c2-4bef-a108-967864afe9f7 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:13.684709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24516405-05cd-4a30-99d9-fb9ece855707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:13.685883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24516405-05cd-4a30-99d9-fb9ece855707 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.686204 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24516405-05cd-4a30-99d9-fb9ece855707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.686567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24516405-05cd-4a30-99d9-fb9ece855707 admin admin] PATH_INFO: `/v3/projects/9828199b50fd4ab6944b5765cf4bc97c/users/b40c893c5c5048feae0f58418e6570c7/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.703251 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24516405-05cd-4a30-99d9-fb9ece855707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9828199b50fd4ab6944b5765cf4bc97c, user_id=b40c893c5c5048feae0f58418e6570c7, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:13.705906 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24516405-05cd-4a30-99d9-fb9ece855707 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:13.721763 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1417/2792] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:13 2022] PUT /identity/v3/projects/9828199b50fd4ab6944b5765cf4bc97c/users/b40c893c5c5048feae0f58418e6570c7/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:13.732806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023b60-754f-449a-953f-95a3a3780428 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.733090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023b60-754f-449a-953f-95a3a3780428 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.733394 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb023b60-754f-449a-953f-95a3a3780428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.761792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-eb023b60-754f-449a-953f-95a3a3780428 None None] MFA Rules not processed for user `b40c893c5c5048feae0f58418e6570c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:13.763050 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-eb023b60-754f-449a-953f-95a3a3780428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:13.832025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1376/2793] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:13.836684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24516405-05cd-4a30-99d9-fb9ece855707 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:13.851194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:13.912044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24516405-05cd-4a30-99d9-fb9ece855707 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:13.916845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17464aee-c26d-4311-8944-898c4fa7fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:13.917514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17464aee-c26d-4311-8944-898c4fa7fa95 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:13.917799 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17464aee-c26d-4311-8944-898c4fa7fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:13.918066 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17464aee-c26d-4311-8944-898c4fa7fa95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:13.918805 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17464aee-c26d-4311-8944-898c4fa7fa95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:13.920702 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17464aee-c26d-4311-8944-898c4fa7fa95 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:13.951336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1418/2794] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:13 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:01:13.955497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb023b60-754f-449a-953f-95a3a3780428 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:13.967568 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb023b60-754f-449a-953f-95a3a3780428 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:14.030596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049902a-e2d8-4feb-99d8-a4111a2f3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:14.031444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049902a-e2d8-4feb-99d8-a4111a2f3407 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:14.031897 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049902a-e2d8-4feb-99d8-a4111a2f3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:14.032221 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049902a-e2d8-4feb-99d8-a4111a2f3407 admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:14.032959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049902a-e2d8-4feb-99d8-a4111a2f3407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:14.035070 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049902a-e2d8-4feb-99d8-a4111a2f3407 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:14.060349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1377/2795] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:13 2022] POST /identity/v3/users => generated 309 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:14.064851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17464aee-c26d-4311-8944-898c4fa7fa95 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:14.076187 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17464aee-c26d-4311-8944-898c4fa7fa95 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:14.081079 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b445e-3141-467d-b1d5-06c2462d652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:14.081793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b445e-3141-467d-b1d5-06c2462d652f admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:14.082154 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b445e-3141-467d-b1d5-06c2462d652f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:14.082334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b445e-3141-467d-b1d5-06c2462d652f admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:14.083125 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b445e-3141-467d-b1d5-06c2462d652f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:14.084724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b445e-3141-467d-b1d5-06c2462d652f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:14.097181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1419/2796] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:14.103190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049902a-e2d8-4feb-99d8-a4111a2f3407 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:14.110091 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:14.116497 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049902a-e2d8-4feb-99d8-a4111a2f3407 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:14.123757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a0470-7a23-4347-900b-18dcaf434d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:14.124708 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a0470-7a23-4347-900b-18dcaf434d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:14.125044 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a0470-7a23-4347-900b-18dcaf434d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:14.125420 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a0470-7a23-4347-900b-18dcaf434d9b admin admin] PATH_INFO: `/v3/projects/ad5d5b94f648492ea7ae08dfcd74cacd/users/b4e3569f42834d62ab301d6a432a0816/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:14.147604 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a0470-7a23-4347-900b-18dcaf434d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5d5b94f648492ea7ae08dfcd74cacd, user_id=b4e3569f42834d62ab301d6a432a0816, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:14.151974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a0470-7a23-4347-900b-18dcaf434d9b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:14.168244 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1378/2797] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:14 2022] PUT /identity/v3/projects/ad5d5b94f648492ea7ae08dfcd74cacd/users/b4e3569f42834d62ab301d6a432a0816/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:01:14.172468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b445e-3141-467d-b1d5-06c2462d652f admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:14.184030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b445e-3141-467d-b1d5-06c2462d652f admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:14.263708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c82819-0c1a-4ef9-84c7-778ba4154320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:14.264895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82819-0c1a-4ef9-84c7-778ba4154320 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:14.265398 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82819-0c1a-4ef9-84c7-778ba4154320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:14.265941 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c82819-0c1a-4ef9-84c7-778ba4154320 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:14.267529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c82819-0c1a-4ef9-84c7-778ba4154320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:14.271091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c82819-0c1a-4ef9-84c7-778ba4154320 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:14.290733 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1420/2798] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:14.294882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a0470-7a23-4347-900b-18dcaf434d9b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:14.306520 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a0470-7a23-4347-900b-18dcaf434d9b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:14.311952 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40479422-8fc3-4210-81f5-8ad625724d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:14.312934 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40479422-8fc3-4210-81f5-8ad625724d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:14.313265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40479422-8fc3-4210-81f5-8ad625724d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:14.313768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40479422-8fc3-4210-81f5-8ad625724d4f admin admin] PATH_INFO: `/v3/projects/ad5d5b94f648492ea7ae08dfcd74cacd/users/b4e3569f42834d62ab301d6a432a0816/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:14.316190 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40479422-8fc3-4210-81f5-8ad625724d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5d5b94f648492ea7ae08dfcd74cacd, user_id=b4e3569f42834d62ab301d6a432a0816, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:14.319111 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40479422-8fc3-4210-81f5-8ad625724d4f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:14.331256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1379/2799] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:14 2022] PUT /identity/v3/projects/ad5d5b94f648492ea7ae08dfcd74cacd/users/b4e3569f42834d62ab301d6a432a0816/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:14.343874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089dcf4-1402-4ccd-bdee-dd766731471d None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:14.344123 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089dcf4-1402-4ccd-bdee-dd766731471d None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:14.344346 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089dcf4-1402-4ccd-bdee-dd766731471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:14.375310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e089dcf4-1402-4ccd-bdee-dd766731471d None None] MFA Rules not processed for user `b4e3569f42834d62ab301d6a432a0816`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:14.376625 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e089dcf4-1402-4ccd-bdee-dd766731471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:14.470746 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1421/2800] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:14.483412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40479422-8fc3-4210-81f5-8ad625724d4f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:14.485380 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-40479422-8fc3-4210-81f5-8ad625724d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:14.555320 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40479422-8fc3-4210-81f5-8ad625724d4f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:14.560450 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71c230-43c1-44fd-9439-45f7b49d3a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:14.561458 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c230-43c1-44fd-9439-45f7b49d3a3c service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:14.562452 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c230-43c1-44fd-9439-45f7b49d3a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:14.563021 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71c230-43c1-44fd-9439-45f7b49d3a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:14.575098 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71c230-43c1-44fd-9439-45f7b49d3a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:14.576573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71c230-43c1-44fd-9439-45f7b49d3a3c service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:14.588481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1380/2801] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:14 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:14.730140 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089dcf4-1402-4ccd-bdee-dd766731471d None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:14.741886 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:14.805208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089dcf4-1402-4ccd-bdee-dd766731471d None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:14.810647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:14.811552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:14.811838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:14.812116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] PATH_INFO: `/v3/users/b40c893c5c5048feae0f58418e6570c7` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:14.813493 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40c893c5c5048feae0f58418e6570c7)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:14.815839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:14.876444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40c893c5c5048feae0f58418e6570c7'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:14.891618 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40c893c5c5048feae0f58418e6570c7'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:14.892407 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40c893c5c5048feae0f58418e6570c7'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:14.901626 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40c893c5c5048feae0f58418e6570c7'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:14.910036 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40c893c5c5048feae0f58418e6570c7'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:14.920620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1422/2802] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:14 2022] DELETE /identity/v3/users/b40c893c5c5048feae0f58418e6570c7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:14.927140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08551-098f-4f7c-8445-c498a58dac91 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:14.928056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08551-098f-4f7c-8445-c498a58dac91 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:14.928056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08551-098f-4f7c-8445-c498a58dac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:14.948142 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-d0b08551-098f-4f7c-8445-c498a58dac91 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:14.949377 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d0b08551-098f-4f7c-8445-c498a58dac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:15.023710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1381/2803] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:15.034865 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:15.036384 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:15.110443 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913e24c-0946-436f-99d2-76aa9aa63488 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:15.114331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3f7d6-6819-4360-8350-ef4bc39fef22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:15.115002 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f7d6-6819-4360-8350-ef4bc39fef22 service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:15.115401 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f7d6-6819-4360-8350-ef4bc39fef22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:15.115681 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f7d6-6819-4360-8350-ef4bc39fef22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:15.125623 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3f7d6-6819-4360-8350-ef4bc39fef22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:15.127170 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3f7d6-6819-4360-8350-ef4bc39fef22 service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:15.137994 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1423/2804] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:15.468793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b08551-098f-4f7c-8445-c498a58dac91 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:15.471147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-d0b08551-098f-4f7c-8445-c498a58dac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:15.489738 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b08551-098f-4f7c-8445-c498a58dac91 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:15.495422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:15.496349 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:15.496640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:15.496927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] PATH_INFO: `/v3/projects/9828199b50fd4ab6944b5765cf4bc97c` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:15.498974 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9828199b50fd4ab6944b5765cf4bc97c)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:15.501025 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:15.559930 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9828199b50fd4ab6944b5765cf4bc97c', 'request_id': 'req-1f0a0896-65ca-48fd-a003-c9c249a701d9'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.568417 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9828199b50fd4ab6944b5765cf4bc97c', 'request_id': 'req-1f0a0896-65ca-48fd-a003-c9c249a701d9'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.576295 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9828199b50fd4ab6944b5765cf4bc97c', 'request_id': 'req-1f0a0896-65ca-48fd-a003-c9c249a701d9'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.580734 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:15.590748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] The token cache is being invalidate because project 9828199b50fd4ab6944b5765cf4bc97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:15.591151 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.592159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.593982 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1382/2805] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:15 2022] DELETE /identity/v3/projects/9828199b50fd4ab6944b5765cf4bc97c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:15.598636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3f7d6-6819-4360-8350-ef4bc39fef22 service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:15.609027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3f7d6-6819-4360-8350-ef4bc39fef22 service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:15.649269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:15.695306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:15.696856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:15.697137 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:15.697420 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] PATH_INFO: `/v3/users/b4e3569f42834d62ab301d6a432a0816` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:15.698711 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e3569f42834d62ab301d6a432a0816)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:15.700669 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:15.761636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e3569f42834d62ab301d6a432a0816'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.774627 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e3569f42834d62ab301d6a432a0816'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.775370 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e3569f42834d62ab301d6a432a0816'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.782433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e3569f42834d62ab301d6a432a0816'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.790973 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-9225e2d8-7334-43dc-8803-41dec76b7b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e3569f42834d62ab301d6a432a0816'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:15.799351 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1424/2806] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:15 2022] DELETE /identity/v3/users/b4e3569f42834d62ab301d6a432a0816 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:16.136573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:16.138478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:16.159403 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a0896-65ca-48fd-a003-c9c249a701d9 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:16.236644 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:16.237514 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.237793 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.238064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] PATH_INFO: `/v3/projects/ad5d5b94f648492ea7ae08dfcd74cacd` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.239285 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5d5b94f648492ea7ae08dfcd74cacd)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:16.241453 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:16.300198 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5d5b94f648492ea7ae08dfcd74cacd', 'request_id': 'req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:16.308246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5d5b94f648492ea7ae08dfcd74cacd', 'request_id': 'req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:16.315227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5d5b94f648492ea7ae08dfcd74cacd', 'request_id': 'req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:16.327659 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] The token cache is being invalidate because project ad5d5b94f648492ea7ae08dfcd74cacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:16.327958 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:16.329024 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-60d2a27b-f9c6-49aa-8c4e-d7f0595d5ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:16.331398 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1383/2807] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:16 2022] DELETE /identity/v3/projects/ad5d5b94f648492ea7ae08dfcd74cacd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:16.338725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0261f0d-a06a-44ea-bb6a-0851c003b36b None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.339275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0261f0d-a06a-44ea-bb6a-0851c003b36b None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.339275 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0261f0d-a06a-44ea-bb6a-0851c003b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.360077 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-c0261f0d-a06a-44ea-bb6a-0851c003b36b None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:16.361301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c0261f0d-a06a-44ea-bb6a-0851c003b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:16.430734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1425/2808] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:16.439007 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d2cb-739a-4ef6-8e8b-2e0eaf1fe244 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.439294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d2cb-739a-4ef6-8e8b-2e0eaf1fe244 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.439569 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6d2cb-739a-4ef6-8e8b-2e0eaf1fe244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.459850 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-b7e6d2cb-739a-4ef6-8e8b-2e0eaf1fe244 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:16.461094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-b7e6d2cb-739a-4ef6-8e8b-2e0eaf1fe244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:16.469723 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1384/2809] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:16.474285 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0261f0d-a06a-44ea-bb6a-0851c003b36b None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:16.494425 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0261f0d-a06a-44ea-bb6a-0851c003b36b None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:16.499089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcdb5e-6e8d-41d9-9ae0-848018ac384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:16.499816 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcdb5e-6e8d-41d9-9ae0-848018ac384e admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.500105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcdb5e-6e8d-41d9-9ae0-848018ac384e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.500387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcdb5e-6e8d-41d9-9ae0-848018ac384e admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.501128 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcdb5e-6e8d-41d9-9ae0-848018ac384e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:01:16.501444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcdb5e-6e8d-41d9-9ae0-848018ac384e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:16.503150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcdb5e-6e8d-41d9-9ae0-848018ac384e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:16.525041 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1426/2810] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 19:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:01:16.529946 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6d2cb-739a-4ef6-8e8b-2e0eaf1fe244 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:16.539574 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6d2cb-739a-4ef6-8e8b-2e0eaf1fe244 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:16.544429 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153f52a-128e-4ada-bac5-e03bbe8f4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:16.545117 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153f52a-128e-4ada-bac5-e03bbe8f4666 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.545395 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153f52a-128e-4ada-bac5-e03bbe8f4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.545677 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153f52a-128e-4ada-bac5-e03bbe8f4666 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.546533 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153f52a-128e-4ada-bac5-e03bbe8f4666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:16.548387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153f52a-128e-4ada-bac5-e03bbe8f4666 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:16.578544 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1385/2811] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:16 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:01:16.583114 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcdb5e-6e8d-41d9-9ae0-848018ac384e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:16.594433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcdb5e-6e8d-41d9-9ae0-848018ac384e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:16.632201 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:16.666685 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e40ac-a837-43e4-b682-52862f25e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:16.667373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e40ac-a837-43e4-b682-52862f25e5aa admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.667671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e40ac-a837-43e4-b682-52862f25e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.667932 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e40ac-a837-43e4-b682-52862f25e5aa admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.668637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e40ac-a837-43e4-b682-52862f25e5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:16.670677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e40ac-a837-43e4-b682-52862f25e5aa admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:16.694350 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1427/2812] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:16 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:01:16.699184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153f52a-128e-4ada-bac5-e03bbe8f4666 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:16.709896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153f52a-128e-4ada-bac5-e03bbe8f4666 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:16.715362 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722094e-c054-49d9-bf2f-20897090b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:16.716061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722094e-c054-49d9-bf2f-20897090b150 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.716358 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722094e-c054-49d9-bf2f-20897090b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.716778 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722094e-c054-49d9-bf2f-20897090b150 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.717468 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722094e-c054-49d9-bf2f-20897090b150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:16.719352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722094e-c054-49d9-bf2f-20897090b150 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:16.731813 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1386/2813] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:16.736115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e40ac-a837-43e4-b682-52862f25e5aa admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:16.747893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e40ac-a837-43e4-b682-52862f25e5aa admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:16.752555 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b1a5-75ad-4e46-bc34-11322ac05f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:16.753238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b1a5-75ad-4e46-bc34-11322ac05f89 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.753523 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b1a5-75ad-4e46-bc34-11322ac05f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.753796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b1a5-75ad-4e46-bc34-11322ac05f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.754576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206b1a5-75ad-4e46-bc34-11322ac05f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:16.756164 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206b1a5-75ad-4e46-bc34-11322ac05f89 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:16.767712 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1428/2814] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:16.772794 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722094e-c054-49d9-bf2f-20897090b150 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:16.785506 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722094e-c054-49d9-bf2f-20897090b150 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:16.790779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d1e90-5b48-4743-ad83-ab109dca5951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:16.791664 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d1e90-5b48-4743-ad83-ab109dca5951 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.791938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d1e90-5b48-4743-ad83-ab109dca5951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.792206 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d1e90-5b48-4743-ad83-ab109dca5951 admin admin] PATH_INFO: `/v3/projects/4e52b0903c284f44bf3c1eb2a6043ce2/users/1203ec4d5ff04a80b2497907a1e3ae93/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.810149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d1e90-5b48-4743-ad83-ab109dca5951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e52b0903c284f44bf3c1eb2a6043ce2, user_id=1203ec4d5ff04a80b2497907a1e3ae93, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:16.813247 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d1e90-5b48-4743-ad83-ab109dca5951 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:16.835875 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1387/2815] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:16 2022] PUT /identity/v3/projects/4e52b0903c284f44bf3c1eb2a6043ce2/users/1203ec4d5ff04a80b2497907a1e3ae93/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:16.847889 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249aae-fa75-4748-8589-bdfd285a5838 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:16.848320 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249aae-fa75-4748-8589-bdfd285a5838 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:16.848725 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249aae-fa75-4748-8589-bdfd285a5838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:16.878616 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-e2249aae-fa75-4748-8589-bdfd285a5838 None None] MFA Rules not processed for user `1203ec4d5ff04a80b2497907a1e3ae93`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:16.880150 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e2249aae-fa75-4748-8589-bdfd285a5838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:16.959604 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1429/2816] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:16.964487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d1e90-5b48-4743-ad83-ab109dca5951 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:16.998351 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:17.049800 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d1e90-5b48-4743-ad83-ab109dca5951 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:17.054561 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe79c8d-83c1-46f2-9af3-61240dd70777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:17.055819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe79c8d-83c1-46f2-9af3-61240dd70777 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:17.056094 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe79c8d-83c1-46f2-9af3-61240dd70777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:17.056365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe79c8d-83c1-46f2-9af3-61240dd70777 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:17.057056 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe79c8d-83c1-46f2-9af3-61240dd70777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:17.059036 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe79c8d-83c1-46f2-9af3-61240dd70777 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:17.086174 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1388/2817] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:16 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:17.090872 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249aae-fa75-4748-8589-bdfd285a5838 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:17.108375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249aae-fa75-4748-8589-bdfd285a5838 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:17.194514 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8d7fc-5909-42de-a0ba-af34539982a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:17.195723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8d7fc-5909-42de-a0ba-af34539982a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:17.196231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8d7fc-5909-42de-a0ba-af34539982a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:17.196735 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8d7fc-5909-42de-a0ba-af34539982a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:17.198051 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8d7fc-5909-42de-a0ba-af34539982a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:17.201955 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8d7fc-5909-42de-a0ba-af34539982a9 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:17.231134 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1430/2818] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:17 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:17.235950 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe79c8d-83c1-46f2-9af3-61240dd70777 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:17.247607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe79c8d-83c1-46f2-9af3-61240dd70777 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:17.252772 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738da05-eb7f-4e0b-9278-2711d80dfa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:17.253410 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738da05-eb7f-4e0b-9278-2711d80dfa24 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:17.253692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738da05-eb7f-4e0b-9278-2711d80dfa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:17.253967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738da05-eb7f-4e0b-9278-2711d80dfa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:17.254852 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738da05-eb7f-4e0b-9278-2711d80dfa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:17.256686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738da05-eb7f-4e0b-9278-2711d80dfa24 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:17.270993 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1389/2819] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:01:17.276589 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8d7fc-5909-42de-a0ba-af34539982a9 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:17.287936 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8d7fc-5909-42de-a0ba-af34539982a9 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:17.293271 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10b995-0e01-4b57-b19e-d127891c443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:17.294172 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10b995-0e01-4b57-b19e-d127891c443c admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:17.294490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10b995-0e01-4b57-b19e-d127891c443c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:17.294772 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10b995-0e01-4b57-b19e-d127891c443c admin admin] PATH_INFO: `/v3/projects/c5eb9d577cd14ed7b8cb77313e7368aa/users/c11b61e9513347998bc8cb2822c8ca03/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:17.312694 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10b995-0e01-4b57-b19e-d127891c443c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5eb9d577cd14ed7b8cb77313e7368aa, user_id=c11b61e9513347998bc8cb2822c8ca03, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:17.315532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10b995-0e01-4b57-b19e-d127891c443c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:17.330069 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1431/2820] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:17 2022] PUT /identity/v3/projects/c5eb9d577cd14ed7b8cb77313e7368aa/users/c11b61e9513347998bc8cb2822c8ca03/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:17.335095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738da05-eb7f-4e0b-9278-2711d80dfa24 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:17.355259 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738da05-eb7f-4e0b-9278-2711d80dfa24 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:17.438905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5552e-561d-472a-9f41-e99223d35168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:17.439682 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5552e-561d-472a-9f41-e99223d35168 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:17.440009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5552e-561d-472a-9f41-e99223d35168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:17.440524 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5552e-561d-472a-9f41-e99223d35168 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:17.441999 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5552e-561d-472a-9f41-e99223d35168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:17.445144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5552e-561d-472a-9f41-e99223d35168 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:17.465685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1390/2821] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:17.470981 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10b995-0e01-4b57-b19e-d127891c443c admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:17.484924 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10b995-0e01-4b57-b19e-d127891c443c admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:17.489602 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67568bbf-c7ac-426e-9722-e92c54b2685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:17.490569 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568bbf-c7ac-426e-9722-e92c54b2685c admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:17.490851 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568bbf-c7ac-426e-9722-e92c54b2685c admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:17.491124 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67568bbf-c7ac-426e-9722-e92c54b2685c admin admin] PATH_INFO: `/v3/projects/c5eb9d577cd14ed7b8cb77313e7368aa/users/c11b61e9513347998bc8cb2822c8ca03/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:17.493216 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67568bbf-c7ac-426e-9722-e92c54b2685c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5eb9d577cd14ed7b8cb77313e7368aa, user_id=c11b61e9513347998bc8cb2822c8ca03, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:17.496398 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67568bbf-c7ac-426e-9722-e92c54b2685c admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:17.505343 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:17.512950 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1432/2822] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:17 2022] PUT /identity/v3/projects/c5eb9d577cd14ed7b8cb77313e7368aa/users/c11b61e9513347998bc8cb2822c8ca03/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:17.523981 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675038eb-5061-401f-8c89-7badf4b252af None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:17.524392 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675038eb-5061-401f-8c89-7badf4b252af None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:17.525182 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675038eb-5061-401f-8c89-7badf4b252af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:17.557041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-675038eb-5061-401f-8c89-7badf4b252af None None] MFA Rules not processed for user `c11b61e9513347998bc8cb2822c8ca03`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:17.558286 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-675038eb-5061-401f-8c89-7badf4b252af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:17.632136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1391/2823] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:17.644072 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67568bbf-c7ac-426e-9722-e92c54b2685c admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:17.646067 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-67568bbf-c7ac-426e-9722-e92c54b2685c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:17.715027 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67568bbf-c7ac-426e-9722-e92c54b2685c admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:17.719228 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55051723-5955-43f6-88ec-129fc5c26acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:17.720004 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55051723-5955-43f6-88ec-129fc5c26acc service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:17.720295 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55051723-5955-43f6-88ec-129fc5c26acc service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:17.720577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55051723-5955-43f6-88ec-129fc5c26acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:17.732205 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55051723-5955-43f6-88ec-129fc5c26acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:17.733771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55051723-5955-43f6-88ec-129fc5c26acc service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:17.744723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1433/2824] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:17.851658 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675038eb-5061-401f-8c89-7badf4b252af None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:17.864251 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675038eb-5061-401f-8c89-7badf4b252af None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:17.868443 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8ec1a-6a06-4756-ab8a-d03f523c1bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:17.869095 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8ec1a-6a06-4756-ab8a-d03f523c1bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:17.869375 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8ec1a-6a06-4756-ab8a-d03f523c1bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:17.869646 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8ec1a-6a06-4756-ab8a-d03f523c1bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:17.884249 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:17.938828 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8ec1a-6a06-4756-ab8a-d03f523c1bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:17.940298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8ec1a-6a06-4756-ab8a-d03f523c1bf8 service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:17.951880 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1392/2825] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:20.721412 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55051723-5955-43f6-88ec-129fc5c26acc service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:20.793116 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55051723-5955-43f6-88ec-129fc5c26acc service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:20.797719 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:20.798634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:20.798921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:20.799202 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] PATH_INFO: `/v3/users/1203ec4d5ff04a80b2497907a1e3ae93` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:20.800463 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1203ec4d5ff04a80b2497907a1e3ae93)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:20.802455 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:20.857660 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1203ec4d5ff04a80b2497907a1e3ae93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:20.872105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1203ec4d5ff04a80b2497907a1e3ae93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:20.873176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1203ec4d5ff04a80b2497907a1e3ae93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:20.884972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1203ec4d5ff04a80b2497907a1e3ae93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:20.895567 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1203ec4d5ff04a80b2497907a1e3ae93'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:20.903284 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1434/2826] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:20 2022] DELETE /identity/v3/users/1203ec4d5ff04a80b2497907a1e3ae93 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:20.908335 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe53dd-ac45-411a-8671-0cf8d44def0d None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:20.908924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe53dd-ac45-411a-8671-0cf8d44def0d None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:20.908924 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe53dd-ac45-411a-8671-0cf8d44def0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:20.933516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2fbe53dd-ac45-411a-8671-0cf8d44def0d None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:20.934799 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2fbe53dd-ac45-411a-8671-0cf8d44def0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:21.007836 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1393/2827] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:21.018552 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:21.020180 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:21.048433 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:21.093175 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1170b7-4e5b-4b6f-8780-cc7faa929f21 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:21.097165 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a3e08-0152-42db-a99e-5b5601ebbc5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:21.097845 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a3e08-0152-42db-a99e-5b5601ebbc5c service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:21.098135 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a3e08-0152-42db-a99e-5b5601ebbc5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:21.098454 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a3e08-0152-42db-a99e-5b5601ebbc5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:21.109592 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a3e08-0152-42db-a99e-5b5601ebbc5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:21.111089 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a3e08-0152-42db-a99e-5b5601ebbc5c service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:21.122260 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1435/2828] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:01:21.511507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe53dd-ac45-411a-8671-0cf8d44def0d None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:21.513853 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2fbe53dd-ac45-411a-8671-0cf8d44def0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:21.536387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe53dd-ac45-411a-8671-0cf8d44def0d None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:21.542696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:21.544333 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:21.544922 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:21.545503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] PATH_INFO: `/v3/projects/4e52b0903c284f44bf3c1eb2a6043ce2` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:21.548074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e52b0903c284f44bf3c1eb2a6043ce2)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:21.552898 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:21.613237 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e52b0903c284f44bf3c1eb2a6043ce2', 'request_id': 'req-2655c8ed-8981-4181-ad9e-fbe8cba730d8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.621892 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e52b0903c284f44bf3c1eb2a6043ce2', 'request_id': 'req-2655c8ed-8981-4181-ad9e-fbe8cba730d8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.629168 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e52b0903c284f44bf3c1eb2a6043ce2', 'request_id': 'req-2655c8ed-8981-4181-ad9e-fbe8cba730d8'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.640660 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] The token cache is being invalidate because project 4e52b0903c284f44bf3c1eb2a6043ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:21.641005 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.641869 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.643573 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1394/2829] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:21 2022] DELETE /identity/v3/projects/4e52b0903c284f44bf3c1eb2a6043ce2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:21.647996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a3e08-0152-42db-a99e-5b5601ebbc5c service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:21.661055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a3e08-0152-42db-a99e-5b5601ebbc5c service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:21.758907 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:21.760143 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:21.760460 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:21.760829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] PATH_INFO: `/v3/users/c11b61e9513347998bc8cb2822c8ca03` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:21.762743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11b61e9513347998bc8cb2822c8ca03)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:21.764849 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:21.828177 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11b61e9513347998bc8cb2822c8ca03'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.848483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11b61e9513347998bc8cb2822c8ca03'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.849411 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11b61e9513347998bc8cb2822c8ca03'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.859443 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11b61e9513347998bc8cb2822c8ca03'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.875441 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-e0d66267-2f70-44f1-8b0d-e37a4d34affa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11b61e9513347998bc8cb2822c8ca03'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:21.882338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1436/2830] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:21 2022] DELETE /identity/v3/users/c11b61e9513347998bc8cb2822c8ca03 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:01:22.203243 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:22.204811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:22.221713 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655c8ed-8981-4181-ad9e-fbe8cba730d8 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:22.298220 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:22.345283 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:22.346848 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.347357 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.347872 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] PATH_INFO: `/v3/projects/c5eb9d577cd14ed7b8cb77313e7368aa` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.350105 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5eb9d577cd14ed7b8cb77313e7368aa)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:22.353955 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:22.423607 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5eb9d577cd14ed7b8cb77313e7368aa', 'request_id': 'req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:22.432132 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5eb9d577cd14ed7b8cb77313e7368aa', 'request_id': 'req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:22.439628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5eb9d577cd14ed7b8cb77313e7368aa', 'request_id': 'req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:22.451929 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] The token cache is being invalidate because project c5eb9d577cd14ed7b8cb77313e7368aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:22.452266 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:22.452881 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-5c0cfa24-dfaf-4550-a1f8-074f11eb1fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:22.454757 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1395/2831] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:22 2022] DELETE /identity/v3/projects/c5eb9d577cd14ed7b8cb77313e7368aa => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:01:22.459930 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af651b12-815c-4c36-b074-c6c2ef19aa37 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.460210 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af651b12-815c-4c36-b074-c6c2ef19aa37 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.460492 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af651b12-815c-4c36-b074-c6c2ef19aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.481207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-af651b12-815c-4c36-b074-c6c2ef19aa37 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:22.482529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-af651b12-815c-4c36-b074-c6c2ef19aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:22.530724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:22.557937 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1437/2832] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:22.566858 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d1d5b-7040-429e-9104-958e7336a924 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.567390 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d1d5b-7040-429e-9104-958e7336a924 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.567798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d1d5b-7040-429e-9104-958e7336a924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.589507 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-ab2d1d5b-7040-429e-9104-958e7336a924 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:22.590824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-ab2d1d5b-7040-429e-9104-958e7336a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:22.600603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1396/2833] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:22.606174 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af651b12-815c-4c36-b074-c6c2ef19aa37 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:22.619812 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af651b12-815c-4c36-b074-c6c2ef19aa37 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:22.624700 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1047179-be2a-44f2-919f-e32d58703e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:22.625384 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047179-be2a-44f2-919f-e32d58703e10 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.625698 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047179-be2a-44f2-919f-e32d58703e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.625977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047179-be2a-44f2-919f-e32d58703e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.626749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047179-be2a-44f2-919f-e32d58703e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:01:22.627059 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047179-be2a-44f2-919f-e32d58703e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:22.628686 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047179-be2a-44f2-919f-e32d58703e10 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:22.642466 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1438/2834] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 19:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:01:22.647112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d1d5b-7040-429e-9104-958e7336a924 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:22.657674 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d1d5b-7040-429e-9104-958e7336a924 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:22.662884 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d00d7e-affb-4160-8afa-fed047cfba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:22.663564 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d00d7e-affb-4160-8afa-fed047cfba1f admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.663849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d00d7e-affb-4160-8afa-fed047cfba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.664147 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d00d7e-affb-4160-8afa-fed047cfba1f admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.664865 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d00d7e-affb-4160-8afa-fed047cfba1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:22.666876 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d00d7e-affb-4160-8afa-fed047cfba1f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:22.696949 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1397/2835] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:22 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:22.701223 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1047179-be2a-44f2-919f-e32d58703e10 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:22.711944 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1047179-be2a-44f2-919f-e32d58703e10 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:22.778139 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d165ad2-6dbb-44cc-9af5-ab1c877a23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:22.778995 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d165ad2-6dbb-44cc-9af5-ab1c877a23a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.779329 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d165ad2-6dbb-44cc-9af5-ab1c877a23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.779657 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d165ad2-6dbb-44cc-9af5-ab1c877a23a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.780501 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d165ad2-6dbb-44cc-9af5-ab1c877a23a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:22.782576 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d165ad2-6dbb-44cc-9af5-ab1c877a23a6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:22.806644 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1439/2836] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:22 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:01:22.812779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d00d7e-affb-4160-8afa-fed047cfba1f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:22.824325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d00d7e-affb-4160-8afa-fed047cfba1f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:22.829261 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa6877-2b8d-40ac-97fa-29b42037a508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:22.830158 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa6877-2b8d-40ac-97fa-29b42037a508 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.830502 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa6877-2b8d-40ac-97fa-29b42037a508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.830782 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa6877-2b8d-40ac-97fa-29b42037a508 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.831536 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa6877-2b8d-40ac-97fa-29b42037a508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:22.833230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa6877-2b8d-40ac-97fa-29b42037a508 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:22.845457 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1398/2837] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:01:22.851188 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d165ad2-6dbb-44cc-9af5-ab1c877a23a6 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:22.862559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d165ad2-6dbb-44cc-9af5-ab1c877a23a6 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:22.868354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c353aa0-edac-4d7f-9224-8f9652160739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:22.869039 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c353aa0-edac-4d7f-9224-8f9652160739 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.869321 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c353aa0-edac-4d7f-9224-8f9652160739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.869599 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c353aa0-edac-4d7f-9224-8f9652160739 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.870331 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c353aa0-edac-4d7f-9224-8f9652160739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:22.871972 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c353aa0-edac-4d7f-9224-8f9652160739 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:22.883203 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1440/2838] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:01:22.887653 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa6877-2b8d-40ac-97fa-29b42037a508 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:22.899080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa6877-2b8d-40ac-97fa-29b42037a508 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:22.904103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685ce6c-d67a-4127-924a-6b5dabbb3b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:22.905011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685ce6c-d67a-4127-924a-6b5dabbb3b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.905298 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685ce6c-d67a-4127-924a-6b5dabbb3b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.905579 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685ce6c-d67a-4127-924a-6b5dabbb3b93 admin admin] PATH_INFO: `/v3/projects/917dab73060d4e7791e8685ff4771a6b/users/dc0efec14a7241819be33ac6fc8061f5/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.931365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685ce6c-d67a-4127-924a-6b5dabbb3b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917dab73060d4e7791e8685ff4771a6b, user_id=dc0efec14a7241819be33ac6fc8061f5, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:22.936967 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685ce6c-d67a-4127-924a-6b5dabbb3b93 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:22.955188 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1399/2839] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:22 2022] PUT /identity/v3/projects/917dab73060d4e7791e8685ff4771a6b/users/dc0efec14a7241819be33ac6fc8061f5/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:22.967918 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6e5e-5073-4982-ae45-487eac34dc4e None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:22.968339 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6e5e-5073-4982-ae45-487eac34dc4e None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:22.968728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6e5e-5073-4982-ae45-487eac34dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:22.998976 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-2cbf6e5e-5073-4982-ae45-487eac34dc4e None None] MFA Rules not processed for user `dc0efec14a7241819be33ac6fc8061f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:23.000240 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2cbf6e5e-5073-4982-ae45-487eac34dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:23.076409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1441/2840] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:23.083719 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685ce6c-d67a-4127-924a-6b5dabbb3b93 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:23.155766 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685ce6c-d67a-4127-924a-6b5dabbb3b93 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:23.160709 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09fae-acf9-427d-8748-9f6fc675561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:23.161387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09fae-acf9-427d-8748-9f6fc675561f admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:23.161666 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09fae-acf9-427d-8748-9f6fc675561f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:23.161938 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af09fae-acf9-427d-8748-9f6fc675561f admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:23.162672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af09fae-acf9-427d-8748-9f6fc675561f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:23.164957 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af09fae-acf9-427d-8748-9f6fc675561f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:23.174176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:23.198408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1400/2841] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:23 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:23.203147 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6e5e-5073-4982-ae45-487eac34dc4e None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:23.218458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6e5e-5073-4982-ae45-487eac34dc4e None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:23.265691 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:23.294480 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19660d-fb23-49ef-9dbb-be07773628f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:23.295159 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19660d-fb23-49ef-9dbb-be07773628f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:23.295442 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19660d-fb23-49ef-9dbb-be07773628f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:23.295716 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19660d-fb23-49ef-9dbb-be07773628f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:23.296415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19660d-fb23-49ef-9dbb-be07773628f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:23.298373 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19660d-fb23-49ef-9dbb-be07773628f8 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:23.322811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1442/2842] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:23 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:23.327608 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09fae-acf9-427d-8748-9f6fc675561f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:23.346179 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af09fae-acf9-427d-8748-9f6fc675561f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:23.352640 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4176a-7f48-42d4-915e-0e120eb83f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:23.353499 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4176a-7f48-42d4-915e-0e120eb83f87 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:23.353827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4176a-7f48-42d4-915e-0e120eb83f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:23.354313 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4176a-7f48-42d4-915e-0e120eb83f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:23.355273 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4176a-7f48-42d4-915e-0e120eb83f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:23.357217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4176a-7f48-42d4-915e-0e120eb83f87 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:23.369326 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1401/2843] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:23.373771 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19660d-fb23-49ef-9dbb-be07773628f8 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:23.385055 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19660d-fb23-49ef-9dbb-be07773628f8 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:23.390073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdbd4b-843a-4acc-8768-d6696c329124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:23.391056 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdbd4b-843a-4acc-8768-d6696c329124 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:23.391334 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdbd4b-843a-4acc-8768-d6696c329124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:23.391605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdbd4b-843a-4acc-8768-d6696c329124 admin admin] PATH_INFO: `/v3/projects/483a598b5bec41a59e563f21372fa8e6/users/a2c59514af4f46e684e2cfa9b13fcc7d/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:23.408778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdbd4b-843a-4acc-8768-d6696c329124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483a598b5bec41a59e563f21372fa8e6, user_id=a2c59514af4f46e684e2cfa9b13fcc7d, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:23.411497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdbd4b-843a-4acc-8768-d6696c329124 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:23.430033 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1443/2844] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:23 2022] PUT /identity/v3/projects/483a598b5bec41a59e563f21372fa8e6/users/a2c59514af4f46e684e2cfa9b13fcc7d/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:23.434367 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4176a-7f48-42d4-915e-0e120eb83f87 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:23.445602 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4176a-7f48-42d4-915e-0e120eb83f87 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:23.518102 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb776ae4-5af8-43a6-bd07-22964694b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:23.518824 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb776ae4-5af8-43a6-bd07-22964694b808 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:23.519112 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb776ae4-5af8-43a6-bd07-22964694b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:23.519387 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb776ae4-5af8-43a6-bd07-22964694b808 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:23.520149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb776ae4-5af8-43a6-bd07-22964694b808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:23.521798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb776ae4-5af8-43a6-bd07-22964694b808 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:23.539393 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1402/2845] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:23.544184 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdbd4b-843a-4acc-8768-d6696c329124 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:23.555257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdbd4b-843a-4acc-8768-d6696c329124 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:23.560550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846de1f-3843-4cd8-94a1-7663661ff87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:23.561465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846de1f-3843-4cd8-94a1-7663661ff87b admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:23.561776 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846de1f-3843-4cd8-94a1-7663661ff87b admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:23.562053 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846de1f-3843-4cd8-94a1-7663661ff87b admin admin] PATH_INFO: `/v3/projects/483a598b5bec41a59e563f21372fa8e6/users/a2c59514af4f46e684e2cfa9b13fcc7d/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:23.564409 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846de1f-3843-4cd8-94a1-7663661ff87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=483a598b5bec41a59e563f21372fa8e6, user_id=a2c59514af4f46e684e2cfa9b13fcc7d, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:23.567126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846de1f-3843-4cd8-94a1-7663661ff87b admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:23.579079 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1444/2846] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:23 2022] PUT /identity/v3/projects/483a598b5bec41a59e563f21372fa8e6/users/a2c59514af4f46e684e2cfa9b13fcc7d/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:23.591160 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85f03-9f2c-4c11-99cc-2a6a21ded07e None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:23.591603 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85f03-9f2c-4c11-99cc-2a6a21ded07e None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:23.591884 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85f03-9f2c-4c11-99cc-2a6a21ded07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:23.621467 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-dff85f03-9f2c-4c11-99cc-2a6a21ded07e None None] MFA Rules not processed for user `a2c59514af4f46e684e2cfa9b13fcc7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:23.622737 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dff85f03-9f2c-4c11-99cc-2a6a21ded07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:23.702541 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1403/2847] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:23.715634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846de1f-3843-4cd8-94a1-7663661ff87b admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:23.717524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-f846de1f-3843-4cd8-94a1-7663661ff87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:23.787410 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846de1f-3843-4cd8-94a1-7663661ff87b admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:23.792356 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003535ba-2038-41f5-b3f8-b0245d1f71bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:23.793030 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003535ba-2038-41f5-b3f8-b0245d1f71bf service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:23.793314 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003535ba-2038-41f5-b3f8-b0245d1f71bf service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:23.793588 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003535ba-2038-41f5-b3f8-b0245d1f71bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:23.807883 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003535ba-2038-41f5-b3f8-b0245d1f71bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:23.810310 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003535ba-2038-41f5-b3f8-b0245d1f71bf service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:23.827397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1445/2848] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:23.907365 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85f03-9f2c-4c11-99cc-2a6a21ded07e None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:23.920692 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85f03-9f2c-4c11-99cc-2a6a21ded07e None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:23.926178 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfef9a-2284-4886-b675-f542db2e26fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:23.926973 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfef9a-2284-4886-b675-f542db2e26fa service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:23.927260 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfef9a-2284-4886-b675-f542db2e26fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:23.927538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfef9a-2284-4886-b675-f542db2e26fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:23.992867 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfef9a-2284-4886-b675-f542db2e26fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:23.994404 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfef9a-2284-4886-b675-f542db2e26fa service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:23.998706 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:24.006517 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1404/2849] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 19:01:24.349835 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003535ba-2038-41f5-b3f8-b0245d1f71bf service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:24.426131 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003535ba-2038-41f5-b3f8-b0245d1f71bf service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:24.431365 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:24.432242 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:24.432530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:24.432804 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] PATH_INFO: `/v3/users/dc0efec14a7241819be33ac6fc8061f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:24.434044 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0efec14a7241819be33ac6fc8061f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:24.436034 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:24.479714 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:24.493603 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0efec14a7241819be33ac6fc8061f5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:24.508347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0efec14a7241819be33ac6fc8061f5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:24.509415 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0efec14a7241819be33ac6fc8061f5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:24.525181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0efec14a7241819be33ac6fc8061f5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:24.535364 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0efec14a7241819be33ac6fc8061f5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:24.542684 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1446/2850] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:24 2022] DELETE /identity/v3/users/dc0efec14a7241819be33ac6fc8061f5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:24.547293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e792b-09ca-4301-be6e-b5c1bf657284 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:24.547804 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e792b-09ca-4301-be6e-b5c1bf657284 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:24.547905 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e792b-09ca-4301-be6e-b5c1bf657284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:24.566359 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f84e792b-09ca-4301-be6e-b5c1bf657284 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:24.567622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f84e792b-09ca-4301-be6e-b5c1bf657284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:24.634613 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1405/2851] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:24.648196 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:24.650631 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:24.715596 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26187003-85c6-4246-b59d-c8d0cb57c337 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:24.719537 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2eba4-b4d6-46b9-af56-841277641b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:24.720213 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2eba4-b4d6-46b9-af56-841277641b0c service neutron] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:24.720497 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2eba4-b4d6-46b9-af56-841277641b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:24.720778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2eba4-b4d6-46b9-af56-841277641b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:24.731927 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2eba4-b4d6-46b9-af56-841277641b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:24.733392 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2eba4-b4d6-46b9-af56-841277641b0c service neutron] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:24.744483 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1447/2852] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:25.069209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e792b-09ca-4301-be6e-b5c1bf657284 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:25.070917 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f84e792b-09ca-4301-be6e-b5c1bf657284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:25.089235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e792b-09ca-4301-be6e-b5c1bf657284 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:25.097486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:25.099779 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:25.100270 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:25.100625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] PATH_INFO: `/v3/projects/917dab73060d4e7791e8685ff4771a6b` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:25.103625 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=917dab73060d4e7791e8685ff4771a6b)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:25.106011 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:25.177066 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917dab73060d4e7791e8685ff4771a6b', 'request_id': 'req-df650eec-0fb1-4d51-aab6-a18e6750bf3a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.188239 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917dab73060d4e7791e8685ff4771a6b', 'request_id': 'req-df650eec-0fb1-4d51-aab6-a18e6750bf3a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.197743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917dab73060d4e7791e8685ff4771a6b', 'request_id': 'req-df650eec-0fb1-4d51-aab6-a18e6750bf3a'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.210662 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] The token cache is being invalidate because project 917dab73060d4e7791e8685ff4771a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:25.210959 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.211919 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.213812 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1406/2853] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:25 2022] DELETE /identity/v3/projects/917dab73060d4e7791e8685ff4771a6b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:25.218904 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2eba4-b4d6-46b9-af56-841277641b0c service neutron] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:25.231168 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2eba4-b4d6-46b9-af56-841277641b0c service neutron] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:25.300550 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:25.301475 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:25.301757 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:25.302040 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] PATH_INFO: `/v3/users/a2c59514af4f46e684e2cfa9b13fcc7d` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:25.303338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c59514af4f46e684e2cfa9b13fcc7d)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:25.305850 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:25.364079 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c59514af4f46e684e2cfa9b13fcc7d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.372680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:25.380327 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c59514af4f46e684e2cfa9b13fcc7d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.381782 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c59514af4f46e684e2cfa9b13fcc7d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.390778 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c59514af4f46e684e2cfa9b13fcc7d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.400264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-6a34b672-c444-4a66-8275-767aedfd1a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c59514af4f46e684e2cfa9b13fcc7d'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.407414 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1448/2854] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:25 2022] DELETE /identity/v3/users/a2c59514af4f46e684e2cfa9b13fcc7d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:01:25.778849 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:25.780469 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:25.797246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df650eec-0fb1-4d51-aab6-a18e6750bf3a admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:25.872108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:25.872987 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:25.873263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:25.873531 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] PATH_INFO: `/v3/projects/483a598b5bec41a59e563f21372fa8e6` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:25.874820 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=483a598b5bec41a59e563f21372fa8e6)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:25.876775 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:25.905054 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:25.936145 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483a598b5bec41a59e563f21372fa8e6', 'request_id': 'req-3aace7a5-ed52-4782-9329-d18abef1f0ac'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.944560 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483a598b5bec41a59e563f21372fa8e6', 'request_id': 'req-3aace7a5-ed52-4782-9329-d18abef1f0ac'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.953338 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483a598b5bec41a59e563f21372fa8e6', 'request_id': 'req-3aace7a5-ed52-4782-9329-d18abef1f0ac'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.965697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] The token cache is being invalidate because project 483a598b5bec41a59e563f21372fa8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86898) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:25.966134 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.967041 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-3aace7a5-ed52-4782-9329-d18abef1f0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:25.969139 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1407/2855] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:25 2022] DELETE /identity/v3/projects/483a598b5bec41a59e563f21372fa8e6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:25.974440 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61b024-609d-406f-be68-0eff7426fddb None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:25.974730 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61b024-609d-406f-be68-0eff7426fddb None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:25.975012 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61b024-609d-406f-be68-0eff7426fddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:25.997762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-ee61b024-609d-406f-be68-0eff7426fddb None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:25.999043 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-ee61b024-609d-406f-be68-0eff7426fddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:26.073827 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1449/2856] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:26.082300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756ad54-7a14-4070-a3b3-2125c92465ff None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.082774 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756ad54-7a14-4070-a3b3-2125c92465ff None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.083149 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756ad54-7a14-4070-a3b3-2125c92465ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.104845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-2756ad54-7a14-4070-a3b3-2125c92465ff None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:26.106271 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-2756ad54-7a14-4070-a3b3-2125c92465ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:26.115748 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1408/2857] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:26.120375 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61b024-609d-406f-be68-0eff7426fddb None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.131519 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61b024-609d-406f-be68-0eff7426fddb None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.137274 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f12ec-2574-43cd-8b1a-bf5afee29517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.137962 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f12ec-2574-43cd-8b1a-bf5afee29517 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.138257 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f12ec-2574-43cd-8b1a-bf5afee29517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.138571 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f12ec-2574-43cd-8b1a-bf5afee29517 admin admin] PATH_INFO: `/v3/domains` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.139338 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f12ec-2574-43cd-8b1a-bf5afee29517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86897) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:01:26.139647 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f12ec-2574-43cd-8b1a-bf5afee29517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.141301 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f12ec-2574-43cd-8b1a-bf5afee29517 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.156458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1450/2858] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 19:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 19:01:26.161540 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756ad54-7a14-4070-a3b3-2125c92465ff None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.173256 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756ad54-7a14-4070-a3b3-2125c92465ff None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.179638 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc679e7-c0c1-49e4-9f54-d5641ae8e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.180628 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc679e7-c0c1-49e4-9f54-d5641ae8e345 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.181061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc679e7-c0c1-49e4-9f54-d5641ae8e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.181503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc679e7-c0c1-49e4-9f54-d5641ae8e345 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.182346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc679e7-c0c1-49e4-9f54-d5641ae8e345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.184512 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc679e7-c0c1-49e4-9f54-d5641ae8e345 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.216444 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1409/2859] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:26 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:26.221390 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f12ec-2574-43cd-8b1a-bf5afee29517 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.233946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f12ec-2574-43cd-8b1a-bf5afee29517 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.311761 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae533f-db99-4dc0-bcb9-fa311f1feb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.312727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae533f-db99-4dc0-bcb9-fa311f1feb3a admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.313028 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae533f-db99-4dc0-bcb9-fa311f1feb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.313293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae533f-db99-4dc0-bcb9-fa311f1feb3a admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.314080 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae533f-db99-4dc0-bcb9-fa311f1feb3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.316149 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae533f-db99-4dc0-bcb9-fa311f1feb3a admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.339607 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1451/2860] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:26 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:01:26.344281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc679e7-c0c1-49e4-9f54-d5641ae8e345 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.356175 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc679e7-c0c1-49e4-9f54-d5641ae8e345 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.361611 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d304ca-8d03-4044-a3af-562a36b26a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.362307 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d304ca-8d03-4044-a3af-562a36b26a91 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.362657 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d304ca-8d03-4044-a3af-562a36b26a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.362927 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d304ca-8d03-4044-a3af-562a36b26a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.363672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d304ca-8d03-4044-a3af-562a36b26a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.365368 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d304ca-8d03-4044-a3af-562a36b26a91 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.377980 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1410/2861] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:26.382534 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae533f-db99-4dc0-bcb9-fa311f1feb3a admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.394734 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae533f-db99-4dc0-bcb9-fa311f1feb3a admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.400336 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810205-e839-47fb-b2a4-28522f8facdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.401078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810205-e839-47fb-b2a4-28522f8facdb admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.401443 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810205-e839-47fb-b2a4-28522f8facdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.401818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810205-e839-47fb-b2a4-28522f8facdb admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.402762 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2810205-e839-47fb-b2a4-28522f8facdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.404559 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2810205-e839-47fb-b2a4-28522f8facdb admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.417784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1452/2862] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:01:26.422732 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d304ca-8d03-4044-a3af-562a36b26a91 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.434743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d304ca-8d03-4044-a3af-562a36b26a91 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.439735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790ee46-ed4f-48e3-9182-aaa75b80b393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.440685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790ee46-ed4f-48e3-9182-aaa75b80b393 admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.440947 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790ee46-ed4f-48e3-9182-aaa75b80b393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.441227 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790ee46-ed4f-48e3-9182-aaa75b80b393 admin admin] PATH_INFO: `/v3/projects/0fb4ff421a7d4acdac83e47fefa80d68/users/1e41db953bd54b9099b4a06805aef911/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.459727 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790ee46-ed4f-48e3-9182-aaa75b80b393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb4ff421a7d4acdac83e47fefa80d68, user_id=1e41db953bd54b9099b4a06805aef911, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.463173 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790ee46-ed4f-48e3-9182-aaa75b80b393 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.479114 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1411/2863] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:26 2022] PUT /identity/v3/projects/0fb4ff421a7d4acdac83e47fefa80d68/users/1e41db953bd54b9099b4a06805aef911/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:26.491714 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b89d-6dca-4b8b-b13d-7e4432830eb6 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.492272 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b89d-6dca-4b8b-b13d-7e4432830eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.492784 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b89d-6dca-4b8b-b13d-7e4432830eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.531249 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-9191b89d-6dca-4b8b-b13d-7e4432830eb6 None None] MFA Rules not processed for user `1e41db953bd54b9099b4a06805aef911`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:26.532673 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-9191b89d-6dca-4b8b-b13d-7e4432830eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:26.568921 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:26.633477 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1453/2864] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:26.638515 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790ee46-ed4f-48e3-9182-aaa75b80b393 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.708571 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790ee46-ed4f-48e3-9182-aaa75b80b393 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.714370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ea9ba-e176-41ee-bd7a-3a9b5fbbe43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.715088 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ea9ba-e176-41ee-bd7a-3a9b5fbbe43f admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.715371 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ea9ba-e176-41ee-bd7a-3a9b5fbbe43f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.715645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ea9ba-e176-41ee-bd7a-3a9b5fbbe43f admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.716352 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ea9ba-e176-41ee-bd7a-3a9b5fbbe43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.718346 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ea9ba-e176-41ee-bd7a-3a9b5fbbe43f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.748711 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1412/2865] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:26 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:26.753141 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191b89d-6dca-4b8b-b13d-7e4432830eb6 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.765120 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191b89d-6dca-4b8b-b13d-7e4432830eb6 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.866766 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72696faf-dc99-4d8c-a53f-e66553105e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.867899 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696faf-dc99-4d8c-a53f-e66553105e67 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.868319 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696faf-dc99-4d8c-a53f-e66553105e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.868728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696faf-dc99-4d8c-a53f-e66553105e67 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.869901 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72696faf-dc99-4d8c-a53f-e66553105e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.874547 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72696faf-dc99-4d8c-a53f-e66553105e67 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.902212 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1454/2866] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:26 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:26.906965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ea9ba-e176-41ee-bd7a-3a9b5fbbe43f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.919471 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ea9ba-e176-41ee-bd7a-3a9b5fbbe43f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.924787 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2682-afbf-4425-81ae-60e7c0b792cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.925705 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2682-afbf-4425-81ae-60e7c0b792cb admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.926086 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2682-afbf-4425-81ae-60e7c0b792cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.926466 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2682-afbf-4425-81ae-60e7c0b792cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.927370 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a2682-afbf-4425-81ae-60e7c0b792cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.929310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a2682-afbf-4425-81ae-60e7c0b792cb admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.941925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1413/2867] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:26.946620 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72696faf-dc99-4d8c-a53f-e66553105e67 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.957578 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72696faf-dc99-4d8c-a53f-e66553105e67 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.962922 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46691397-36d1-4bf3-9af5-2531b4b4c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:26.963601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46691397-36d1-4bf3-9af5-2531b4b4c099 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:26.963885 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46691397-36d1-4bf3-9af5-2531b4b4c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:26.964160 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46691397-36d1-4bf3-9af5-2531b4b4c099 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:26.964895 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46691397-36d1-4bf3-9af5-2531b4b4c099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:26.966566 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46691397-36d1-4bf3-9af5-2531b4b4c099 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:26.978880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1455/2868] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:26.983596 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2682-afbf-4425-81ae-60e7c0b792cb admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:26.994144 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2682-afbf-4425-81ae-60e7c0b792cb admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:26.999355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160948cc-2d88-4023-9791-d7886a47062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:27.000184 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160948cc-2d88-4023-9791-d7886a47062f admin admin] REQUEST_METHOD: `PUT` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.000493 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160948cc-2d88-4023-9791-d7886a47062f admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.000767 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160948cc-2d88-4023-9791-d7886a47062f admin admin] PATH_INFO: `/v3/projects/f1cc3d7ec91d45579a307706e5a7c10f/users/172a4085c97944deb80ac43a95176421/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:27.017637 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160948cc-2d88-4023-9791-d7886a47062f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cc3d7ec91d45579a307706e5a7c10f, user_id=172a4085c97944deb80ac43a95176421, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:27.020438 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160948cc-2d88-4023-9791-d7886a47062f admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:27.030645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:27.039717 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1414/2869] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:26 2022] PUT /identity/v3/projects/f1cc3d7ec91d45579a307706e5a7c10f/users/172a4085c97944deb80ac43a95176421/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:01:27.051487 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210e92-a7a8-4264-9db6-9a0d2c773bee None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.051783 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210e92-a7a8-4264-9db6-9a0d2c773bee None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.052117 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210e92-a7a8-4264-9db6-9a0d2c773bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:27.090577 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-08210e92-a7a8-4264-9db6-9a0d2c773bee None None] MFA Rules not processed for user `172a4085c97944deb80ac43a95176421`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:27.091838 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-08210e92-a7a8-4264-9db6-9a0d2c773bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:27.195743 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1456/2870] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:27.201123 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160948cc-2d88-4023-9791-d7886a47062f admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:27.300169 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160948cc-2d88-4023-9791-d7886a47062f admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:27.306052 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893c0c0-857f-472a-9c05-9566b888b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:27.306776 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893c0c0-857f-472a-9c05-9566b888b931 admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.307059 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893c0c0-857f-472a-9c05-9566b888b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.307332 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893c0c0-857f-472a-9c05-9566b888b931 admin admin] PATH_INFO: `/v3/projects` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:27.308046 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893c0c0-857f-472a-9c05-9566b888b931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:27.310028 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893c0c0-857f-472a-9c05-9566b888b931 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:27.340911 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1415/2871] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:27 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:27.345286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08210e92-a7a8-4264-9db6-9a0d2c773bee None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:27.364565 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08210e92-a7a8-4264-9db6-9a0d2c773bee None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:27.428211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:27.463688 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd755-e0f0-439d-854c-ddd9d1c94b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:27.464387 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd755-e0f0-439d-854c-ddd9d1c94b59 admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.464675 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd755-e0f0-439d-854c-ddd9d1c94b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.464945 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd755-e0f0-439d-854c-ddd9d1c94b59 admin admin] PATH_INFO: `/v3/users` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:27.465788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd755-e0f0-439d-854c-ddd9d1c94b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:27.467829 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd755-e0f0-439d-854c-ddd9d1c94b59 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:27.493238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1457/2872] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:27 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:27.500161 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893c0c0-857f-472a-9c05-9566b888b931 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:27.519445 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893c0c0-857f-472a-9c05-9566b888b931 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:27.528103 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2c4a4-28da-4ebc-99a9-ccebc992769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:27.529246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2c4a4-28da-4ebc-99a9-ccebc992769b admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.529741 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2c4a4-28da-4ebc-99a9-ccebc992769b admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.530235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2c4a4-28da-4ebc-99a9-ccebc992769b admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:27.531697 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2c4a4-28da-4ebc-99a9-ccebc992769b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:27.534783 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2c4a4-28da-4ebc-99a9-ccebc992769b admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:27.556503 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1416/2873] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:27.561105 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd755-e0f0-439d-854c-ddd9d1c94b59 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:27.573082 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd755-e0f0-439d-854c-ddd9d1c94b59 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:27.578744 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff0f71-3344-4084-951e-d4600ad465b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:27.579668 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff0f71-3344-4084-951e-d4600ad465b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.579957 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff0f71-3344-4084-951e-d4600ad465b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.580231 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff0f71-3344-4084-951e-d4600ad465b6 admin admin] PATH_INFO: `/v3/projects/6162b2d4d85e46c89ab7657f1f5c51fe/users/bf20828ce92e41df8ac33fcc5c90f8e5/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:27.598444 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff0f71-3344-4084-951e-d4600ad465b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6162b2d4d85e46c89ab7657f1f5c51fe, user_id=bf20828ce92e41df8ac33fcc5c90f8e5, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:27.601194 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff0f71-3344-4084-951e-d4600ad465b6 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:27.619394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1458/2874] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:27 2022] PUT /identity/v3/projects/6162b2d4d85e46c89ab7657f1f5c51fe/users/bf20828ce92e41df8ac33fcc5c90f8e5/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:27.625136 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2c4a4-28da-4ebc-99a9-ccebc992769b admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:27.637246 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2c4a4-28da-4ebc-99a9-ccebc992769b admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:27.703454 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c625d08-247a-4a93-b619-d8784f4184df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:27.704350 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c625d08-247a-4a93-b619-d8784f4184df admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.704743 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c625d08-247a-4a93-b619-d8784f4184df admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.705168 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c625d08-247a-4a93-b619-d8784f4184df admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:27.706127 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c625d08-247a-4a93-b619-d8784f4184df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:27.708077 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c625d08-247a-4a93-b619-d8784f4184df admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:27.720118 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1417/2875] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 19:01:27.724732 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff0f71-3344-4084-951e-d4600ad465b6 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:27.736619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff0f71-3344-4084-951e-d4600ad465b6 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:27.742935 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31dc03-bc13-402b-86ae-89228ac806e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:27.743929 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31dc03-bc13-402b-86ae-89228ac806e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.744255 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31dc03-bc13-402b-86ae-89228ac806e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.744600 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31dc03-bc13-402b-86ae-89228ac806e2 admin admin] PATH_INFO: `/v3/projects/6162b2d4d85e46c89ab7657f1f5c51fe/users/bf20828ce92e41df8ac33fcc5c90f8e5/roles/4b2eb24a17124a3a903910accd72f5f5` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:27.747078 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31dc03-bc13-402b-86ae-89228ac806e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6162b2d4d85e46c89ab7657f1f5c51fe, user_id=bf20828ce92e41df8ac33fcc5c90f8e5, role_id=4b2eb24a17124a3a903910accd72f5f5)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:27.750293 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31dc03-bc13-402b-86ae-89228ac806e2 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:27.763541 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1459/2876] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:27 2022] PUT /identity/v3/projects/6162b2d4d85e46c89ab7657f1f5c51fe/users/bf20828ce92e41df8ac33fcc5c90f8e5/roles/4b2eb24a17124a3a903910accd72f5f5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:27.776287 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed937a-548c-47ee-82a5-7e65b408d8dd None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.776622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed937a-548c-47ee-82a5-7e65b408d8dd None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.776983 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed937a-548c-47ee-82a5-7e65b408d8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:27.808699 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-dfed937a-548c-47ee-82a5-7e65b408d8dd None None] MFA Rules not processed for user `bf20828ce92e41df8ac33fcc5c90f8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:27.809896 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dfed937a-548c-47ee-82a5-7e65b408d8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:27.882265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:27.895864 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1418/2877] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:27.912490 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31dc03-bc13-402b-86ae-89228ac806e2 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:27.914512 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3f31dc03-bc13-402b-86ae-89228ac806e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:27.984465 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31dc03-bc13-402b-86ae-89228ac806e2 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:27.988946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9330-f492-41d0-9e67-cf353aa5fd72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:27.989671 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9330-f492-41d0-9e67-cf353aa5fd72 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:27.989996 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9330-f492-41d0-9e67-cf353aa5fd72 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:27.990317 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9330-f492-41d0-9e67-cf353aa5fd72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:28.077459 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e9330-f492-41d0-9e67-cf353aa5fd72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:28.078876 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e9330-f492-41d0-9e67-cf353aa5fd72 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:28.091333 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1460/2878] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:29.741735 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed937a-548c-47ee-82a5-7e65b408d8dd None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:29.744031 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-dfed937a-548c-47ee-82a5-7e65b408d8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:29.758068 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed937a-548c-47ee-82a5-7e65b408d8dd None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:29.762181 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b8a61-2f85-4f10-b7be-ab897ff11f0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:29.762889 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b8a61-2f85-4f10-b7be-ab897ff11f0d service cinder] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:29.763205 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b8a61-2f85-4f10-b7be-ab897ff11f0d service cinder] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:29.763477 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b8a61-2f85-4f10-b7be-ab897ff11f0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:29.849686 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b8a61-2f85-4f10-b7be-ab897ff11f0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:29.851300 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b8a61-2f85-4f10-b7be-ab897ff11f0d service cinder] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:29.863185 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1419/2879] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:30.617949 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9330-f492-41d0-9e67-cf353aa5fd72 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:30.628708 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9330-f492-41d0-9e67-cf353aa5fd72 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:30.635796 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc1d6-e197-42ac-88b1-0896d515a822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:30.636856 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc1d6-e197-42ac-88b1-0896d515a822 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:30.637322 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc1d6-e197-42ac-88b1-0896d515a822 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:30.637737 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc1d6-e197-42ac-88b1-0896d515a822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:30.649822 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cc1d6-e197-42ac-88b1-0896d515a822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:30.651316 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cc1d6-e197-42ac-88b1-0896d515a822 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:30.662983 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1461/2880] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:34.650318 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b8a61-2f85-4f10-b7be-ab897ff11f0d service cinder] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:34.733281 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b8a61-2f85-4f10-b7be-ab897ff11f0d service cinder] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:34.738250 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:34.739176 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:34.739464 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:34.739768 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] PATH_INFO: `/v3/users/1e41db953bd54b9099b4a06805aef911` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:34.741069 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e41db953bd54b9099b4a06805aef911)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:34.743159 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:34.802645 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e41db953bd54b9099b4a06805aef911'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:34.817355 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e41db953bd54b9099b4a06805aef911'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:34.818099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e41db953bd54b9099b4a06805aef911'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:34.828791 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e41db953bd54b9099b4a06805aef911'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:34.840501 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e41db953bd54b9099b4a06805aef911'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:34.851868 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1420/2881] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:34 2022] DELETE /identity/v3/users/1e41db953bd54b9099b4a06805aef911 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:34.857874 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ff435-2b67-40f1-8148-9004c9a774dd None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:34.858572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ff435-2b67-40f1-8148-9004c9a774dd None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:34.858572 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ff435-2b67-40f1-8148-9004c9a774dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:34.877815 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-2f1ff435-2b67-40f1-8148-9004c9a774dd None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:34.879115 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2f1ff435-2b67-40f1-8148-9004c9a774dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:34.910520 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:34.953728 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1462/2882] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:34.964925 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:34.969478 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:34.986480 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:35.043718 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010c4cd-e550-47c0-a03d-61838843bd50 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:35.048193 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301f79-306f-44ba-827f-29b7a585d4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:35.049128 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301f79-306f-44ba-827f-29b7a585d4ec service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:35.049516 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301f79-306f-44ba-827f-29b7a585d4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:35.049891 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301f79-306f-44ba-827f-29b7a585d4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:35.062276 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec301f79-306f-44ba-827f-29b7a585d4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:35.063985 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec301f79-306f-44ba-827f-29b7a585d4ec service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:35.077965 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1421/2883] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:35.427715 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ff435-2b67-40f1-8148-9004c9a774dd None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:35.430775 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-2f1ff435-2b67-40f1-8148-9004c9a774dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:35.455893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ff435-2b67-40f1-8148-9004c9a774dd None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:35.462810 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:35.463867 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:35.464207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:35.464601 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] PATH_INFO: `/v3/projects/0fb4ff421a7d4acdac83e47fefa80d68` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:35.466214 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb4ff421a7d4acdac83e47fefa80d68)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:35.468721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:35.533898 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb4ff421a7d4acdac83e47fefa80d68', 'request_id': 'req-78542f17-2ca4-4244-bf48-e862f3bf04d5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.542100 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb4ff421a7d4acdac83e47fefa80d68', 'request_id': 'req-78542f17-2ca4-4244-bf48-e862f3bf04d5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.551432 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb4ff421a7d4acdac83e47fefa80d68', 'request_id': 'req-78542f17-2ca4-4244-bf48-e862f3bf04d5'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.566464 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] The token cache is being invalidate because project 0fb4ff421a7d4acdac83e47fefa80d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:35.566960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.567931 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.570562 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1463/2884] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:35 2022] DELETE /identity/v3/projects/0fb4ff421a7d4acdac83e47fefa80d68 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:35.575587 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301f79-306f-44ba-827f-29b7a585d4ec service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:35.587265 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301f79-306f-44ba-827f-29b7a585d4ec service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:35.657272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:35.658074 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:35.658361 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:35.658672 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] PATH_INFO: `/v3/users/172a4085c97944deb80ac43a95176421` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:35.659961 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=172a4085c97944deb80ac43a95176421)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:35.661968 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:35.722217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172a4085c97944deb80ac43a95176421'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.737487 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172a4085c97944deb80ac43a95176421'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.738321 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172a4085c97944deb80ac43a95176421'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.747275 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172a4085c97944deb80ac43a95176421'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.756293 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172a4085c97944deb80ac43a95176421'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:35.764429 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1422/2885] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:35 2022] DELETE /identity/v3/users/172a4085c97944deb80ac43a95176421 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:01:36.106363 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:36.108920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:36.129127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78542f17-2ca4-4244-bf48-e862f3bf04d5 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:36.206875 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:36.207767 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:36.208073 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:36.208347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] PATH_INFO: `/v3/projects/f1cc3d7ec91d45579a307706e5a7c10f` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:36.209593 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cc3d7ec91d45579a307706e5a7c10f)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:36.212091 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:36.281361 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cc3d7ec91d45579a307706e5a7c10f', 'request_id': 'req-daefdeba-2bdf-4498-af48-0d5c54070742'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.293366 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cc3d7ec91d45579a307706e5a7c10f', 'request_id': 'req-daefdeba-2bdf-4498-af48-0d5c54070742'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.298637 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:36.306727 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cc3d7ec91d45579a307706e5a7c10f', 'request_id': 'req-daefdeba-2bdf-4498-af48-0d5c54070742'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.322619 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] The token cache is being invalidate because project f1cc3d7ec91d45579a307706e5a7c10f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:36.322920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.323634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.326215 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1464/2886] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:36 2022] DELETE /identity/v3/projects/f1cc3d7ec91d45579a307706e5a7c10f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:36.331831 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:36.334157 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:36.356528 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726abf97-90f4-4f99-af93-e343d369f6a4 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:36.401939 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:36.441552 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:36.443146 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:36.443600 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:36.444061 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] PATH_INFO: `/v3/users/bf20828ce92e41df8ac33fcc5c90f8e5` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:36.446461 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf20828ce92e41df8ac33fcc5c90f8e5)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:36.450263 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:36.523601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf20828ce92e41df8ac33fcc5c90f8e5'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.538933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf20828ce92e41df8ac33fcc5c90f8e5'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.539903 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf20828ce92e41df8ac33fcc5c90f8e5'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.548164 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf20828ce92e41df8ac33fcc5c90f8e5'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.557685 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-294b3352-73ee-4a95-b03b-6d3e204e113a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf20828ce92e41df8ac33fcc5c90f8e5'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:36.564863 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1423/2887] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:01:36 2022] DELETE /identity/v3/users/bf20828ce92e41df8ac33fcc5c90f8e5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:36.937451 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:36.939933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:36.959611 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefdeba-2bdf-4498-af48-0d5c54070742 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:37.050062 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:37.050636 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.050920 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.051248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] PATH_INFO: `/v3/projects/6162b2d4d85e46c89ab7657f1f5c51fe` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.052846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6162b2d4d85e46c89ab7657f1f5c51fe)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:37.055808 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:37.113570 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6162b2d4d85e46c89ab7657f1f5c51fe', 'request_id': 'req-fc4b26a4-573f-4b4f-a858-efe046d20211'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:37.121544 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6162b2d4d85e46c89ab7657f1f5c51fe', 'request_id': 'req-fc4b26a4-573f-4b4f-a858-efe046d20211'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:37.130347 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6162b2d4d85e46c89ab7657f1f5c51fe', 'request_id': 'req-fc4b26a4-573f-4b4f-a858-efe046d20211'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:37.146185 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] The token cache is being invalidate because project 6162b2d4d85e46c89ab7657f1f5c51fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:01:37.146582 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:37.147354 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-fc4b26a4-573f-4b4f-a858-efe046d20211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:01:37.149522 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1465/2888] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:01:36 2022] DELETE /identity/v3/projects/6162b2d4d85e46c89ab7657f1f5c51fe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:01:37.155124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ca02-6ebc-4caf-bc11-07fff9e69684 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.156010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ca02-6ebc-4caf-bc11-07fff9e69684 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.156010 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ca02-6ebc-4caf-bc11-07fff9e69684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.177746 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-9593ca02-6ebc-4caf-bc11-07fff9e69684 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:37.179080 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-9593ca02-6ebc-4caf-bc11-07fff9e69684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:37.256058 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1424/2889] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:37.265372 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ebd6-7896-46a4-ab70-5301ff1017e0 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.265709 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ebd6-7896-46a4-ab70-5301ff1017e0 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.265902 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ebd6-7896-46a4-ab70-5301ff1017e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.286696 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-6881ebd6-7896-46a4-ab70-5301ff1017e0 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:37.287998 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-6881ebd6-7896-46a4-ab70-5301ff1017e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:37.296640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1466/2890] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:37.301592 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593ca02-6ebc-4caf-bc11-07fff9e69684 None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:37.315127 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593ca02-6ebc-4caf-bc11-07fff9e69684 None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:37.320656 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc24b86-1191-4473-ac05-79f93fa396d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:37.321386 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc24b86-1191-4473-ac05-79f93fa396d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.321707 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc24b86-1191-4473-ac05-79f93fa396d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.322022 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc24b86-1191-4473-ac05-79f93fa396d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.322882 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc24b86-1191-4473-ac05-79f93fa396d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 19:01:37.323235 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc24b86-1191-4473-ac05-79f93fa396d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:37.325064 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc24b86-1191-4473-ac05-79f93fa396d4 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:37.341730 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1425/2891] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jun 16 19:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 19:01:37.346615 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ebd6-7896-46a4-ab70-5301ff1017e0 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:37.357207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ebd6-7896-46a4-ab70-5301ff1017e0 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:37.363195 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce04d5-00b1-4591-ae39-e56b3cd3849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:37.363871 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce04d5-00b1-4591-ae39-e56b3cd3849e admin admin] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.364181 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce04d5-00b1-4591-ae39-e56b3cd3849e admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.364472 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce04d5-00b1-4591-ae39-e56b3cd3849e admin admin] PATH_INFO: `/v3/projects` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.365680 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce04d5-00b1-4591-ae39-e56b3cd3849e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:37.368721 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce04d5-00b1-4591-ae39-e56b3cd3849e admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:37.400264 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1467/2892] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jun 16 19:01:37 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 19:01:37.404715 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc24b86-1191-4473-ac05-79f93fa396d4 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:37.417840 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc24b86-1191-4473-ac05-79f93fa396d4 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:37.468422 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:37.497344 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df098ac-8436-42b9-aa01-0308eeeed64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:37.498617 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df098ac-8436-42b9-aa01-0308eeeed64e admin admin] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.499122 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df098ac-8436-42b9-aa01-0308eeeed64e admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.499622 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df098ac-8436-42b9-aa01-0308eeeed64e admin admin] PATH_INFO: `/v3/users` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.500992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df098ac-8436-42b9-aa01-0308eeeed64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:37.504845 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df098ac-8436-42b9-aa01-0308eeeed64e admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:37.539129 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1426/2893] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jun 16 19:01:37 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 19:01:37.544256 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce04d5-00b1-4591-ae39-e56b3cd3849e admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:37.556437 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce04d5-00b1-4591-ae39-e56b3cd3849e admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:37.561634 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b458c2d-4e09-4221-94fd-380b5d588d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:37.562400 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b458c2d-4e09-4221-94fd-380b5d588d25 admin admin] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.562745 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b458c2d-4e09-4221-94fd-380b5d588d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.563064 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b458c2d-4e09-4221-94fd-380b5d588d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.563946 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b458c2d-4e09-4221-94fd-380b5d588d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:37.565677 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b458c2d-4e09-4221-94fd-380b5d588d25 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:37.578779 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1468/2894] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:01:37.583430 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df098ac-8436-42b9-aa01-0308eeeed64e admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:37.594445 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df098ac-8436-42b9-aa01-0308eeeed64e admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:37.599992 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265965c8-899c-4a5d-a58d-e4424fdca5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:37.600763 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265965c8-899c-4a5d-a58d-e4424fdca5dc admin admin] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.601090 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265965c8-899c-4a5d-a58d-e4424fdca5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.601401 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265965c8-899c-4a5d-a58d-e4424fdca5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.602258 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265965c8-899c-4a5d-a58d-e4424fdca5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:37.604310 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265965c8-899c-4a5d-a58d-e4424fdca5dc admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:37.615798 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1427/2895] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jun 16 19:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 19:01:37.621130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b458c2d-4e09-4221-94fd-380b5d588d25 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:37.634999 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b458c2d-4e09-4221-94fd-380b5d588d25 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:37.640806 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84c8e0-59e4-4642-8c28-a814531cfe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:37.641724 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84c8e0-59e4-4642-8c28-a814531cfe15 admin admin] REQUEST_METHOD: `PUT` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.642006 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84c8e0-59e4-4642-8c28-a814531cfe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.642281 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84c8e0-59e4-4642-8c28-a814531cfe15 admin admin] PATH_INFO: `/v3/projects/853008c147764a598e1f5eccdf4940e4/users/10d6004a3d794b10bcc196f9e87b0d49/roles/78293db45f4044a093a98d4ab1475ca9` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.662530 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84c8e0-59e4-4642-8c28-a814531cfe15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853008c147764a598e1f5eccdf4940e4, user_id=10d6004a3d794b10bcc196f9e87b0d49, role_id=78293db45f4044a093a98d4ab1475ca9)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:37.665679 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84c8e0-59e4-4642-8c28-a814531cfe15 admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:37.681793 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1469/2896] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jun 16 19:01:37 2022] PUT /identity/v3/projects/853008c147764a598e1f5eccdf4940e4/users/10d6004a3d794b10bcc196f9e87b0d49/roles/78293db45f4044a093a98d4ab1475ca9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:01:37.692459 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a807-4684-46a0-aa24-51cfe888b7d3 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.692797 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a807-4684-46a0-aa24-51cfe888b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.693152 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3a807-4684-46a0-aa24-51cfe888b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.742140 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-f1c3a807-4684-46a0-aa24-51cfe888b7d3 None None] MFA Rules not processed for user `10d6004a3d794b10bcc196f9e87b0d49`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:37.744209 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f1c3a807-4684-46a0-aa24-51cfe888b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:37.866020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1428/2897] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:37.878130 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84c8e0-59e4-4642-8c28-a814531cfe15 admin admin] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:37.879975 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-0f84c8e0-59e4-4642-8c28-a814531cfe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:37.895910 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:37.949605 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84c8e0-59e4-4642-8c28-a814531cfe15 admin admin] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:37.954007 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6d66-30c1-490c-9a75-11b76ec41d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '387fd99ff326463698bc32947ba25d77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:37.954720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6d66-30c1-490c-9a75-11b76ec41d10 service cinder] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:37.955008 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6d66-30c1-490c-9a75-11b76ec41d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:37.955286 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6d66-30c1-490c-9a75-11b76ec41d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:37.966729 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6d66-30c1-490c-9a75-11b76ec41d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:37.968238 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6d66-30c1-490c-9a75-11b76ec41d10 service cinder] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:37.978042 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1470/2898] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:39.409953 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0753f-cb80-4f17-885a-00dcc2c07e3b None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:39.410601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0753f-cb80-4f17-885a-00dcc2c07e3b None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:39.410601 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0753f-cb80-4f17-885a-00dcc2c07e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:39.429294 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-1ae0753f-cb80-4f17-885a-00dcc2c07e3b None None] MFA Rules not processed for user `10d6004a3d794b10bcc196f9e87b0d49`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:39.430552 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1ae0753f-cb80-4f17-885a-00dcc2c07e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:39.437663 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1429/2899] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:01:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 19:01:40.976353 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6d66-30c1-490c-9a75-11b76ec41d10 service cinder] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:40.977862 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-e67e6d66-30c1-490c-9a75-11b76ec41d10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:41.056649 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6d66-30c1-490c-9a75-11b76ec41d10 service cinder] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:41.063676 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:41.064846 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:41.065413 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:41.066690 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:41.070524 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:41.084938 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:41.087394 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:41.103933 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1471/2900] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:46.008374 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0753f-cb80-4f17-885a-00dcc2c07e3b None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:46.009915 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-1ae0753f-cb80-4f17-885a-00dcc2c07e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:46.074827 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0753f-cb80-4f17-885a-00dcc2c07e3b None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:46.078623 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b9de0-8fc7-4f62-bba1-67dd617c465a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:46.079486 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9de0-8fc7-4f62-bba1-67dd617c465a service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:46.082823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9de0-8fc7-4f62-bba1-67dd617c465a service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:46.082823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9de0-8fc7-4f62-bba1-67dd617c465a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:46.082823 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-063b9de0-8fc7-4f62-bba1-67dd617c465a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:46.092325 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b9de0-8fc7-4f62-bba1-67dd617c465a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:46.093776 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b9de0-8fc7-4f62-bba1-67dd617c465a service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:46.105042 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1430/2901] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:51.094212 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=53 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:52.204259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:52.205754 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:52.296839 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339c68-d8ae-41a9-ac63-2e0c3a499287 service placement] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:52.303267 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cba70fa423e413a9222021116ff5718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:52.303961 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:52.304248 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:52.304535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:52.306503 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:52.320445 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:52.323186 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:52.340268 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1472/2902] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:01:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:01:56.098807 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:56.513802 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983deb2-885f-4263-a50b-0a3fbea73894 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:56.514363 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983deb2-885f-4263-a50b-0a3fbea73894 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:56.514846 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983deb2-885f-4263-a50b-0a3fbea73894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:56.539272 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-4983deb2-885f-4263-a50b-0a3fbea73894 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:56.540476 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-4983deb2-885f-4263-a50b-0a3fbea73894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:56.599408 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1431/2903] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 19:01:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:56.649723 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:56.654500 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:56.726818 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a70247-f3a2-4f88-a01e-38e427d78113 service nova] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:56.732279 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e805c-855c-4787-bad4-620ecdda4635 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:56.732977 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e805c-855c-4787-bad4-620ecdda4635 service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:56.733259 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e805c-855c-4787-bad4-620ecdda4635 service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:56.733532 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e805c-855c-4787-bad4-620ecdda4635 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:56.742905 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e805c-855c-4787-bad4-620ecdda4635 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:56.744424 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e805c-855c-4787-bad4-620ecdda4635 service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:56.753217 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1473/2904] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 19:01:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:57.285248 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5039-6ae6-4a3f-a0f6-7a1c73b52440 None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:57.285806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5039-6ae6-4a3f-a0f6-7a1c73b52440 None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:57.285806 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5039-6ae6-4a3f-a0f6-7a1c73b52440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:57.305222 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-88ad5039-6ae6-4a3f-a0f6-7a1c73b52440 None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:57.306481 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-88ad5039-6ae6-4a3f-a0f6-7a1c73b52440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:57.314000 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1432/2905] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jun 16 19:01:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:57.327613 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e805c-855c-4787-bad4-620ecdda4635 service swift] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:57.341893 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e805c-855c-4787-bad4-620ecdda4635 service swift] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:57.347292 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44693-c3ca-436a-bea3-3dc57e248007 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:57.348083 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44693-c3ca-436a-bea3-3dc57e248007 service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:57.348269 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44693-c3ca-436a-bea3-3dc57e248007 service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:57.348546 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44693-c3ca-436a-bea3-3dc57e248007 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:57.357720 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b44693-c3ca-436a-bea3-3dc57e248007 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:57.359344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b44693-c3ca-436a-bea3-3dc57e248007 service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:57.368325 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1474/2906] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 19:01:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 19:01:57.581504 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a0bd-a7cc-47ee-adc2-dc8631f1cadf None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:57.581786 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a0bd-a7cc-47ee-adc2-dc8631f1cadf None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:57.582081 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a0bd-a7cc-47ee-adc2-dc8631f1cadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:57.601230 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-5280a0bd-a7cc-47ee-adc2-dc8631f1cadf None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:57.602483 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5280a0bd-a7cc-47ee-adc2-dc8631f1cadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:57.609908 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1433/2907] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jun 16 19:01:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:57.623318 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44693-c3ca-436a-bea3-3dc57e248007 service swift] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:57.636101 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44693-c3ca-436a-bea3-3dc57e248007 service swift] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:57.641535 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64c65-c905-43da-86a4-34fd5e5864f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:57.642207 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64c65-c905-43da-86a4-34fd5e5864f6 service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:57.642529 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64c65-c905-43da-86a4-34fd5e5864f6 service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:57.642809 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64c65-c905-43da-86a4-34fd5e5864f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:57.652468 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b64c65-c905-43da-86a4-34fd5e5864f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:57.654126 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b64c65-c905-43da-86a4-34fd5e5864f6 service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:57.665158 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1475/2908] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 19:01:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:58.032933 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8bb9b-7226-4c79-82b9-20c24f3fbc3c None None] REQUEST_METHOD: `POST` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:58.033217 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8bb9b-7226-4c79-82b9-20c24f3fbc3c None None] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:58.033491 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8bb9b-7226-4c79-82b9-20c24f3fbc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:58.055124 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.auth.core [None req-5fc8bb9b-7226-4c79-82b9-20c24f3fbc3c None None] MFA Rules not processed for user `6e8f3976dd524feeb4277e4ba4c8090b`. Rule list: `[]` (Enabled: `True`). {{(pid=86898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:01:58.063811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-5fc8bb9b-7226-4c79-82b9-20c24f3fbc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:01:58.063811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1434/2909] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jun 16 19:01:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:01:58.076368 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64c65-c905-43da-86a4-34fd5e5864f6 service swift] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:01:58.087176 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64c65-c905-43da-86a4-34fd5e5864f6 service swift] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:01:58.092496 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f15cd4-6ea7-4027-a2ae-e5de26369e03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7da017f9a5b4bfcb5b97b5310e0a146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:01:58.093162 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15cd4-6ea7-4027-a2ae-e5de26369e03 service swift] REQUEST_METHOD: `GET` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:01:58.093449 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15cd4-6ea7-4027-a2ae-e5de26369e03 service swift] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:01:58.093726 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15cd4-6ea7-4027-a2ae-e5de26369e03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:01:58.103458 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f15cd4-6ea7-4027-a2ae-e5de26369e03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:01:58.105085 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f15cd4-6ea7-4027-a2ae-e5de26369e03 service swift] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:01:58.114127 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1476/2910] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jun 16 19:01:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 19:02:00.246819 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8bb9b-7226-4c79-82b9-20c24f3fbc3c None None] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:00.322619 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8bb9b-7226-4c79-82b9-20c24f3fbc3c None None] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:00.327135 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:00.328003 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.328282 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.328555 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] PATH_INFO: `/v3/users/10d6004a3d794b10bcc196f9e87b0d49` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.329944 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d6004a3d794b10bcc196f9e87b0d49)` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:00.332381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.381696 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d6004a3d794b10bcc196f9e87b0d49'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.394030 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d6004a3d794b10bcc196f9e87b0d49'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.394784 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d6004a3d794b10bcc196f9e87b0d49'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.401792 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d6004a3d794b10bcc196f9e87b0d49'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.409108 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.notifications [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d6004a3d794b10bcc196f9e87b0d49'} {{(pid=86898) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.415649 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1435/2911] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jun 16 19:02:00 2022] DELETE /identity/v3/users/10d6004a3d794b10bcc196f9e87b0d49 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 19:02:00.420254 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ba711-4cc3-47ed-bac6-e6fda30271e2 None None] REQUEST_METHOD: `POST` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.420749 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ba711-4cc3-47ed-bac6-e6fda30271e2 None None] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.420854 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ba711-4cc3-47ed-bac6-e6fda30271e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.439225 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.auth.core [None req-3e9ba711-4cc3-47ed-bac6-e6fda30271e2 None None] MFA Rules not processed for user `d16970c992ef45ad92a1879619e5cda1`. Rule list: `[]` (Enabled: `True`). {{(pid=86897) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 19:02:00.440450 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3e9ba711-4cc3-47ed-bac6-e6fda30271e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:00.471960 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=100 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:00.503208 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1477/2912] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jun 16 19:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 19:02:00.512679 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:00.514143 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:00.521009 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:00.578100 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c4088-d25a-441f-be0f-21836d1190d1 admin admin] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:00.581749 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af9e7-e893-4bd1-9b9c-c89ace3387f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11a8567e1254a0080cbe74efe0127f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:00.582428 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af9e7-e893-4bd1-9b9c-c89ace3387f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.582710 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af9e7-e893-4bd1-9b9c-c89ace3387f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.582984 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723af9e7-e893-4bd1-9b9c-c89ace3387f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.592680 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723af9e7-e893-4bd1-9b9c-c89ace3387f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:00.594101 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723af9e7-e893-4bd1-9b9c-c89ace3387f1 service neutron] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.604020 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1436/2913] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:02:00.771788 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ba711-4cc3-47ed-bac6-e6fda30271e2 None None] Authenticating user token {{(pid=86897) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:02:00.774075 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.fernet_utils [None req-3e9ba711-4cc3-47ed-bac6-e6fda30271e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86897) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:02:00.786262 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ba711-4cc3-47ed-bac6-e6fda30271e2 None None] Validating token access rules against request {{(pid=86897) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:02:00.791640 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd16970c992ef45ad92a1879619e5cda1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b921b8affc14177a85b3aac3f02deca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86897) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:02:00.792598 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:02:00.792880 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:02:00.793151 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] PATH_INFO: `/v3/projects/853008c147764a598e1f5eccdf4940e4` {{(pid=86897) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:02:00.794344 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=853008c147764a598e1f5eccdf4940e4)` {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:02:00.796315 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] RBAC: Authorization granted {{(pid=86897) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:02:00.847306 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853008c147764a598e1f5eccdf4940e4', 'request_id': 'req-03795178-e4ec-4192-816f-47512ec2dffd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.854211 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853008c147764a598e1f5eccdf4940e4', 'request_id': 'req-03795178-e4ec-4192-816f-47512ec2dffd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.861811 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853008c147764a598e1f5eccdf4940e4', 'request_id': 'req-03795178-e4ec-4192-816f-47512ec2dffd'} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.872397 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] The token cache is being invalidate because project 853008c147764a598e1f5eccdf4940e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86897) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 19:02:00.872682 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.873322 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG keystone.notifications [None req-03795178-e4ec-4192-816f-47512ec2dffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86897) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 19:02:00.874890 dv-cinder-846171-1-smb devstack@keystone.service[86897]: [pid: 86897|app: 0|req: 1478/2914] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jun 16 19:02:00 2022] DELETE /identity/v3/projects/853008c147764a598e1f5eccdf4940e4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 19:02:10.599381 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=24 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:10.869653 dv-cinder-846171-1-smb devstack@keystone.service[86897]: DEBUG dbcounter [-] [86897] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:30.538006 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af9e7-e893-4bd1-9b9c-c89ace3387f1 service neutron] Authenticating user token {{(pid=86898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 19:04:30.539538 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-723af9e7-e893-4bd1-9b9c-c89ace3387f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:30.713811 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723af9e7-e893-4bd1-9b9c-c89ace3387f1 service neutron] Validating token access rules against request {{(pid=86898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 19:04:30.787521 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997ed27-08d9-4efc-b049-5aeab17b76d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '167e32465f314f4caf9f8df4a4710dbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ce75b1ed5614e5ea2b6cadaed5e3287', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 19:04:30.788099 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997ed27-08d9-4efc-b049-5aeab17b76d4 service placement] REQUEST_METHOD: `GET` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 19:04:30.788412 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997ed27-08d9-4efc-b049-5aeab17b76d4 service placement] SCRIPT_NAME: `/identity` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 19:04:30.788690 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997ed27-08d9-4efc-b049-5aeab17b76d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 19:04:30.792155 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.fernet_utils [None req-f997ed27-08d9-4efc-b049-5aeab17b76d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 19:04:30.804201 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997ed27-08d9-4efc-b049-5aeab17b76d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 19:04:30.805835 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997ed27-08d9-4efc-b049-5aeab17b76d4 service placement] RBAC: Authorization granted {{(pid=86898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 19:04:30.818414 dv-cinder-846171-1-smb devstack@keystone.service[86898]: [pid: 86898|app: 0|req: 1437/2915] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jun 16 19:04:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 19:04:40.813684 dv-cinder-846171-1-smb devstack@keystone.service[86898]: DEBUG dbcounter [-] [86898] Writing DB stats keystone:SELECT=89 {{(pid=86898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}